Aug 09 19:13:12 user nova-compute[72441]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 19:13:15 user nova-compute[72441]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72441) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72441) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72441) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 19:13:15 user nova-compute[72441]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:13:15 user nova-compute[72441]: INFO nova.virt.driver [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 19:13:15 user nova-compute[72441]: INFO nova.compute.provider_config [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Acquiring lock "singleton_lock" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Acquired lock "singleton_lock" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Releasing lock "singleton_lock" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Full set of CONF: {{(pid=72441) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ******************************************************************************** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Configuration options gathered from: {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ================================================================================ {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] allow_resize_to_same_host      = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] arq_binding_timeout            = 300 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] backdoor_port                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] backdoor_socket                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] block_device_allocate_retries  = 300 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] block_device_allocate_retries_interval = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cert                           = self.pem {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute_monitors               = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] config_dir                     = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] config_drive_format            = iso9660 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] config_source                  = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] console_host                   = user {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] control_exchange               = nova {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cpu_allocation_ratio           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] daemon                         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] debug                          = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] default_access_ip_network_name = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] default_availability_zone      = nova {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] default_ephemeral_format       = ext4 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] default_schedule_zone          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] disk_allocation_ratio          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] enable_new_services            = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] enabled_ssl_apis               = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] flat_injected                  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] force_config_drive             = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] force_raw_images               = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] graceful_shutdown_timeout      = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] heal_instance_info_cache_interval = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] host                           = user {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_build_timeout         = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_delete_interval       = 300 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_name_template         = instance-%08x {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_usage_audit           = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_usage_audit_period    = month {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] internal_service_availability_zone = internal {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] key                            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] live_migration_retry_count     = 30 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_config_append              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_dir                        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_file                       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_options                    = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_rotate_interval            = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_rotate_interval_type       = days {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] log_rotation_type              = none {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] long_rpc_timeout               = 1800 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] max_concurrent_builds          = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] max_concurrent_live_migrations = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] max_concurrent_snapshots       = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] max_local_block_devices        = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] max_logfile_count              = 30 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] max_logfile_size_mb            = 200 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] maximum_instance_delete_attempts = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metadata_listen                = 0.0.0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metadata_listen_port           = 8775 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metadata_workers               = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] migrate_max_retries            = -1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] mkisofs_cmd                    = genisoimage {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] my_ip                          = 10.0.0.210 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] network_allocate_retries       = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] osapi_compute_listen_port      = 8774 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] osapi_compute_unique_server_name_scope =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] osapi_compute_workers          = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] password_length                = 12 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] periodic_enable                = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] periodic_fuzzy_delay           = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] pointer_model                  = ps2mouse {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] preallocate_images             = none {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] publish_errors                 = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] pybasedir                      = /opt/stack/nova {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ram_allocation_ratio           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rate_limit_burst               = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rate_limit_except_level        = CRITICAL {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rate_limit_interval            = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reboot_timeout                 = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reclaim_instance_interval      = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] record                         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reimage_timeout_per_gb         = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] report_interval                = 120 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rescue_timeout                 = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reserved_host_cpus             = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reserved_host_disk_mb          = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reserved_host_memory_mb        = 512 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] reserved_huge_pages            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] resize_confirm_window          = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] resize_fs_using_block_device   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] resume_guests_state_on_host_boot = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rpc_response_timeout           = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] run_external_periodic_tasks    = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] running_deleted_instance_action = reap {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] running_deleted_instance_timeout = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler_instance_sync_interval = 120 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_down_time              = 720 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] servicegroup_driver            = db {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] shelved_offload_time           = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] shelved_poll_interval          = 3600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] shutdown_timeout               = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] source_is_ipv6                 = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ssl_only                       = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] state_path                     = /opt/stack/data/nova {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] sync_power_state_interval      = 600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] sync_power_state_pool_size     = 1000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] syslog_log_facility            = LOG_USER {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] tempdir                        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] timeout_nbd                    = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] transport_url                  = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] update_resources_interval      = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_cow_images                 = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_eventlog                   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_journal                    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_json                       = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_rootwrap_daemon            = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_stderr                     = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] use_syslog                     = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vcpu_pin_set                   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plugging_is_fatal          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plugging_timeout           = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] virt_mkfs                      = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] volume_usage_poll_interval     = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] watch_log_file                 = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] web                            = /usr/share/spice-html5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_concurrency.disable_process_locking = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.auth_strategy              = keystone {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.compute_link_prefix        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.dhcp_domain                = novalocal {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.enable_instance_password   = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.glance_link_prefix         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.instance_list_per_project_cells = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.list_records_by_skipping_down_cells = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.local_metadata_per_cell    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.max_limit                  = 1000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.metadata_cache_expiration  = 15 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.neutron_default_tenant_id  = default {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.use_forwarded_for          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.use_neutron_default_nets   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_dynamic_targets = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_jsonfile_path   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.backend_argument         = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.config_prefix            = cache.oslo {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.dead_timeout             = 60.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.debug_cache_backend      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.enable_retry_client      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.enable_socket_keepalive  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.enabled                  = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.expiration_time          = 600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.hashclient_retry_attempts = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_dead_retry      = 300 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_password        =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_sasl_enabled    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.memcache_username        =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.proxies                  = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.retry_attempts           = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.retry_delay              = 0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.socket_keepalive_count   = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.socket_keepalive_idle    = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.socket_keepalive_interval = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.tls_allowed_ciphers      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.tls_cafile               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.tls_certfile             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.tls_enabled              = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cache.tls_keyfile              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.auth_section            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.auth_type               = password {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.cafile                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.certfile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.collect_timing          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.cross_az_attach         = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.debug                   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.endpoint_template       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.http_retries            = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.insecure                = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.keyfile                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.os_region_name          = RegionOne {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.split_loggers           = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cinder.timeout                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.cpu_dedicated_set      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.cpu_shared_set         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.image_type_exclude_list = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.resource_provider_association_refresh = 300 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.shutdown_retry_interval = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] conductor.workers              = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] console.allowed_origins        = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] console.ssl_ciphers            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] console.ssl_minimum_version    = default {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] consoleauth.token_ttl          = 600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.cafile                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.certfile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.collect_timing          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.connect_retries         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.connect_retry_delay     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.endpoint_override       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.insecure                = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.keyfile                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.max_version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.min_version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.region_name             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.service_name            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.service_type            = accelerator {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.split_loggers           = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.status_code_retries     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.timeout                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] cyborg.version                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.backend               = sqlalchemy {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.connection            = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.connection_debug      = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.connection_parameters =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.connection_recycle_time = 3600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.connection_trace      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.db_inc_retry_interval = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.db_max_retries        = 20 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.db_max_retry_interval = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.db_retry_interval     = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.max_overflow          = 50 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.max_pool_size         = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.max_retries           = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.mysql_enable_ndb      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.mysql_wsrep_sync_wait = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.pool_timeout          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.retry_interval        = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.slave_connection      = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] database.sqlite_synchronous    = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.backend           = sqlalchemy {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.connection        = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.connection_debug  = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.connection_parameters =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.connection_recycle_time = 3600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.connection_trace  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.db_inc_retry_interval = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.db_max_retries    = 20 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.db_max_retry_interval = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.db_retry_interval = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.max_overflow      = 50 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.max_pool_size     = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.max_retries       = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.mysql_enable_ndb  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.pool_timeout      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.retry_interval    = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.slave_connection  = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] api_database.sqlite_synchronous = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] devices.enabled_mdev_types     = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ephemeral_storage_encryption.enabled = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.api_servers             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.cafile                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.certfile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.collect_timing          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.connect_retries         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.connect_retry_delay     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.debug                   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.default_trusted_certificate_ids = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.enable_certificate_validation = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.enable_rbd_download     = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.endpoint_override       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.insecure                = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.keyfile                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.max_version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.min_version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.num_retries             = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.rbd_ceph_conf           =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.rbd_connect_timeout     = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.rbd_pool                =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.rbd_user                =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.region_name             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.service_name            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.service_type            = image {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.split_loggers           = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.status_code_retries     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.timeout                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.verify_glance_signatures = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] glance.version                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] guestfs.debug                  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.config_drive_cdrom      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.config_drive_inject_password = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.enable_remotefx         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.instances_path_share    =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.limit_cpu_features      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.use_multipath_io        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.vswitch_name            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] mks.enabled                    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] image_cache.manager_interval   = 2400 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] image_cache.precache_concurrency = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] image_cache.remove_unused_base_images = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] image_cache.subdirectory_name  = _base {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.api_max_retries         = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.api_retry_interval      = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.auth_section            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.auth_type               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.cafile                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.certfile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.collect_timing          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.connect_retries         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.connect_retry_delay     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.endpoint_override       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.insecure                = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.keyfile                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.max_version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.min_version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.partition_key           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.peer_list               = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.region_name             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.serial_console_state_timeout = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.service_name            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.service_type            = baremetal {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.split_loggers           = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.status_code_retries     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.timeout                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ironic.version                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] key_manager.fixed_key          = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.barbican_api_version  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.barbican_endpoint     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.barbican_endpoint_type = public {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.barbican_region_name  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.cafile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.certfile              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.collect_timing        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.insecure              = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.keyfile               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.number_of_retries     = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.retry_delay           = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.send_service_user_token = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.split_loggers         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.timeout               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.verify_ssl            = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican.verify_ssl_path       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.auth_section = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.auth_type = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.cafile   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.certfile = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.collect_timing = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.insecure = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.keyfile  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.split_loggers = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] barbican_service_user.timeout  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.approle_role_id          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.approle_secret_id        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.cafile                   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.certfile                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.collect_timing           = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.insecure                 = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.keyfile                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.kv_mountpoint            = secret {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.kv_version               = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.namespace                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.root_token_id            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.split_loggers            = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.ssl_ca_crt_file          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.timeout                  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.use_ssl                  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.cafile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.certfile              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.collect_timing        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.connect_retries       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.connect_retry_delay   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.endpoint_override     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.insecure              = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.keyfile               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.max_version           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.min_version           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.region_name           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.service_name          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.service_type          = identity {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.split_loggers         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.status_code_retries   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.timeout               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] keystone.version               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.connection_uri         =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_mode               = custom {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: WARNING oslo_config.cfg [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_power_governor_high = performance {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_power_management   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.device_detach_attempts = 8 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.device_detach_timeout  = 20 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.disk_cachemodes        = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.disk_prefix            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.enabled_perf_events    = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.file_backed_memory     = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.gid_maps               = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.hw_disk_discard        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.hw_machine_type        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_rbd_pool        = rbd {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_type            = default {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.images_volume_group    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.inject_key             = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.inject_partition       = -2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.inject_password        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.iscsi_iface            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.iser_use_multipath     = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_downtime = 500 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_inbound_addr = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_scheme  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_timeout_action = abort {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_tunnelled = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: WARNING oslo_config.cfg [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 19:13:15 user nova-compute[72441]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 19:13:15 user nova-compute[72441]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 19:13:15 user nova-compute[72441]: and ``live_migration_inbound_addr`` respectively.
Aug 09 19:13:15 user nova-compute[72441]: ).  Its value may be silently ignored in the future.
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.live_migration_with_native_tls = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.max_queues             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.nfs_mount_options      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.num_pcie_ports         = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.pmem_namespaces        = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.quobyte_client_cfg     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rbd_secret_uuid        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rbd_user               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rescue_image_id        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rescue_kernel_id       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.rx_queue_size          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.smbfs_mount_options    =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.snapshot_compression   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.snapshot_image_format  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.sparse_logical_volumes = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.swtpm_enabled          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.swtpm_group            = tss {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.swtpm_user             = tss {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.sysinfo_serial         = unique {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.tb_cache_size          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.tx_queue_size          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.uid_maps               = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.use_virtio_for_bridges = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.virt_type              = kvm {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.volume_clear           = zero {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.volume_clear_size      = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.volume_use_multipath   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_cache_path   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.auth_section           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.auth_type              = password {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.cafile                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.certfile               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.collect_timing         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.connect_retries        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.connect_retry_delay    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.default_floating_pool  = public {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.endpoint_override      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.extension_sync_interval = 600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.http_retries           = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.insecure               = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.keyfile                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.max_version            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.min_version            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.ovs_bridge             = br-int {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.physnets               = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.region_name            = RegionOne {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.service_metadata_proxy = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.service_name           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.service_type           = network {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.split_loggers          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.status_code_retries    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.timeout                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] neutron.version                = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] notifications.bdms_in_notifications = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] notifications.default_level    = INFO {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] notifications.notification_format = unversioned {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] notifications.notify_on_state_change = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] pci.alias                      = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] pci.device_spec                = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] pci.report_in_placement        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.auth_section         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.auth_type            = password {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.cafile               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.certfile             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.collect_timing       = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.connect_retries      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.connect_retry_delay  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.default_domain_id    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.default_domain_name  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.domain_id            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.domain_name          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.endpoint_override    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.insecure             = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.keyfile              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.max_version          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.min_version          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.password             = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.project_domain_id    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.project_domain_name  = Default {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.project_id           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.project_name         = service {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.region_name          = RegionOne {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.service_name         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.service_type         = placement {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.split_loggers        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.status_code_retries  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.system_scope         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.timeout              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.trust_id             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.user_domain_id       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.user_domain_name     = Default {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.user_id              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.username             = placement {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] placement.version              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.cores                    = 20 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.count_usage_from_placement = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.injected_file_content_bytes = 10240 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.injected_file_path_length = 255 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.injected_files           = 5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.instances                = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.key_pairs                = 100 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.metadata_items           = 128 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.ram                      = 51200 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.recheck_quota            = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.server_group_members     = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] quota.server_groups            = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rdp.enabled                    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.image_metadata_prefilter = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.max_attempts         = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.max_placement_results = 1000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] scheduler.workers              = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.host_subset_size = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.isolated_hosts = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.isolated_images = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.pci_in_placement = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.track_instance_changes = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metrics.required               = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metrics.weight_multiplier      = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] metrics.weight_setting         = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] serial_console.enabled         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] serial_console.port_range      = 10000:20000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] serial_console.serialproxy_port = 6083 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.auth_section      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.auth_type         = password {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.cafile            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.certfile          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.collect_timing    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.insecure          = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.keyfile           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.send_service_user_token = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.split_loggers     = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] service_user.timeout           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.agent_enabled            = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.enabled                  = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.html5proxy_port          = 6082 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.image_compression        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.jpeg_compression         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.playback_compression     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.server_listen            = 127.0.0.1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.streaming_mode           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] spice.zlib_compression         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] upgrade_levels.baseapi         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] upgrade_levels.cert            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] upgrade_levels.compute         = auto {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] upgrade_levels.conductor       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] upgrade_levels.scheduler       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.cafile = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.certfile = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.insecure = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vendordata_dynamic_auth.timeout = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.api_retry_count         = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.ca_file                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.cache_prefix            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.cluster_name            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.connection_pool_size    = 10 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.console_delay_seconds   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.datastore_regex         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.host_ip                 = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.host_password           = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.host_port               = 443 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.host_username           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.insecure                = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.integration_bridge      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.maximum_objects         = 100 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.pbm_default_policy      = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.pbm_enabled             = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.pbm_wsdl_location       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.serial_port_proxy_uri   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.serial_port_service_uri = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.task_poll_interval      = 0.5 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.use_linked_clone        = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.vnc_keymap              = en-us {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.vnc_port                = 5900 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vmware.vnc_port_total          = 10000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:15 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.auth_schemes               = ['none'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.enabled                    = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.novncproxy_port            = 6080 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.vencrypt_ca_certs          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.vencrypt_client_cert       = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vnc.vencrypt_client_key        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.disable_rootwrap   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.enable_numa_live_migration = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.libvirt_disable_apic = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.client_socket_timeout     = 900 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.default_pool_size         = 1000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.keep_alive                = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.max_header_line           = 16384 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.ssl_ca_file               = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.ssl_cert_file             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.ssl_key_file              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.tcp_keepidle              = 600 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] zvm.ca_file                    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] zvm.cloud_connector_url        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] zvm.reachable_timeout          = 300 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.enforce_new_defaults = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.enforce_scope      = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.policy_default_rule = default {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.connection_string     = messaging:// {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.enabled               = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.es_doc_type           = notification {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.es_scroll_size        = 10000 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.es_scroll_time        = 2m {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.filter_error_trace    = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.hmac_keys             = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.sentinel_service_name = mymaster {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.socket_timeout        = 0.1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.trace_requests        = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler.trace_sqlalchemy      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler_jaeger.process_tags   = {} {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler_jaeger.service_name_prefix = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] profiler_otlp.service_name_prefix = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] remote_debug.host              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] remote_debug.port              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_notifications.retry = -1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.auth_section        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.auth_type           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.cafile              = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.certfile            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.collect_timing      = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.connect_retries     = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.connect_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.endpoint_id         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.endpoint_override   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.insecure            = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.keyfile             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.max_version         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.min_version         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.region_name         = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.service_name        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.service_type        = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.split_loggers       = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.status_code_retries = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.status_code_retry_delay = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.timeout             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.valid_interfaces    = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_limit.version             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_reports.file_event_handler = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] oslo_reports.log_dir           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_ovs_privileged.group  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] vif_plug_ovs_privileged.user   = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_ovs.isolate_vif         = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] os_brick.lock_path             = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] privsep_osbrick.capabilities   = [21] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] privsep_osbrick.group          = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] privsep_osbrick.helper_command = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] privsep_osbrick.user           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] nova_sys_admin.group           = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] nova_sys_admin.helper_command  = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] nova_sys_admin.user            = None {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG oslo_service.service [None req-8038ae48-b808-4b76-8c7a-9f0a55496b77 None None] ******************************************************************************** {{(pid=72441) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 19:13:16 user nova-compute[72441]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Starting native event thread {{(pid=72441) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Starting green dispatch thread {{(pid=72441) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Starting connection event dispatch thread {{(pid=72441) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Connecting to libvirt: qemu:///system {{(pid=72441) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fbda0fdcaf0> {{(pid=72441) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fbda0fdcaf0> {{(pid=72441) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 19:13:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Connection event '1' reason 'None'
Aug 09 19:13:16 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 19:13:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.mount [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Initialising _HostMountState generation 0 {{(pid=72441) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 19:13:23 user nova-compute[72441]: INFO nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host capabilities <capabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <host>
Aug 09 19:13:23 user nova-compute[72441]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 19:13:23 user nova-compute[72441]:     <cpu>
Aug 09 19:13:23 user nova-compute[72441]:       <arch>x86_64</arch>
Aug 09 19:13:23 user nova-compute[72441]:       <model>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <microcode version='1070'/>
Aug 09 19:13:23 user nova-compute[72441]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='osxsave'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='invtsc'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='rsba'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 19:13:23 user nova-compute[72441]:       <pages unit='KiB' size='4'/>
Aug 09 19:13:23 user nova-compute[72441]:       <pages unit='KiB' size='2048'/>
Aug 09 19:13:23 user nova-compute[72441]:     </cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <power_management>
Aug 09 19:13:23 user nova-compute[72441]:       <suspend_mem/>
Aug 09 19:13:23 user nova-compute[72441]:       <suspend_disk/>
Aug 09 19:13:23 user nova-compute[72441]:       <suspend_hybrid/>
Aug 09 19:13:23 user nova-compute[72441]:     </power_management>
Aug 09 19:13:23 user nova-compute[72441]:     <iommu support='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <migration_features>
Aug 09 19:13:23 user nova-compute[72441]:       <live/>
Aug 09 19:13:23 user nova-compute[72441]:       <uri_transports>
Aug 09 19:13:23 user nova-compute[72441]:         <uri_transport>tcp</uri_transport>
Aug 09 19:13:23 user nova-compute[72441]:         <uri_transport>rdma</uri_transport>
Aug 09 19:13:23 user nova-compute[72441]:       </uri_transports>
Aug 09 19:13:23 user nova-compute[72441]:     </migration_features>
Aug 09 19:13:23 user nova-compute[72441]:     <topology>
Aug 09 19:13:23 user nova-compute[72441]:       <cells num='2'>
Aug 09 19:13:23 user nova-compute[72441]:         <cell id='0'>
Aug 09 19:13:23 user nova-compute[72441]:           <memory unit='KiB'>8189224</memory>
Aug 09 19:13:23 user nova-compute[72441]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 09 19:13:23 user nova-compute[72441]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 19:13:23 user nova-compute[72441]:           <distances>
Aug 09 19:13:23 user nova-compute[72441]:             <sibling id='0' value='10'/>
Aug 09 19:13:23 user nova-compute[72441]:             <sibling id='1' value='20'/>
Aug 09 19:13:23 user nova-compute[72441]:           </distances>
Aug 09 19:13:23 user nova-compute[72441]:           <cpus num='6'>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 19:13:23 user nova-compute[72441]:           </cpus>
Aug 09 19:13:23 user nova-compute[72441]:         </cell>
Aug 09 19:13:23 user nova-compute[72441]:         <cell id='1'>
Aug 09 19:13:23 user nova-compute[72441]:           <memory unit='KiB'>8206460</memory>
Aug 09 19:13:23 user nova-compute[72441]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 09 19:13:23 user nova-compute[72441]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 19:13:23 user nova-compute[72441]:           <distances>
Aug 09 19:13:23 user nova-compute[72441]:             <sibling id='0' value='20'/>
Aug 09 19:13:23 user nova-compute[72441]:             <sibling id='1' value='10'/>
Aug 09 19:13:23 user nova-compute[72441]:           </distances>
Aug 09 19:13:23 user nova-compute[72441]:           <cpus num='6'>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 19:13:23 user nova-compute[72441]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 19:13:23 user nova-compute[72441]:           </cpus>
Aug 09 19:13:23 user nova-compute[72441]:         </cell>
Aug 09 19:13:23 user nova-compute[72441]:       </cells>
Aug 09 19:13:23 user nova-compute[72441]:     </topology>
Aug 09 19:13:23 user nova-compute[72441]:     <cache>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 19:13:23 user nova-compute[72441]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 19:13:23 user nova-compute[72441]:     </cache>
Aug 09 19:13:23 user nova-compute[72441]:     <secmodel>
Aug 09 19:13:23 user nova-compute[72441]:       <model>apparmor</model>
Aug 09 19:13:23 user nova-compute[72441]:       <doi>0</doi>
Aug 09 19:13:23 user nova-compute[72441]:     </secmodel>
Aug 09 19:13:23 user nova-compute[72441]:     <secmodel>
Aug 09 19:13:23 user nova-compute[72441]:       <model>dac</model>
Aug 09 19:13:23 user nova-compute[72441]:       <doi>0</doi>
Aug 09 19:13:23 user nova-compute[72441]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 19:13:23 user nova-compute[72441]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 19:13:23 user nova-compute[72441]:     </secmodel>
Aug 09 19:13:23 user nova-compute[72441]:   </host>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='alpha'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>clipper</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='armv6l'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>spitz</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>nuri</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>kzm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sx1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>z2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>tosa</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>n810</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>n800</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>terrier</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>midway</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>microbit</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>verdex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>highbank</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>akita</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>connex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>collie</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='armv7l'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>spitz</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>nuri</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>kzm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sx1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>z2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>tosa</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>n810</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>n800</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>terrier</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>midway</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>microbit</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>verdex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>highbank</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>akita</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>connex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>collie</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='aarch64'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>spitz</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>nuri</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>kzm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sx1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>z2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>tosa</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>n810</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>n800</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>terrier</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>midway</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>microbit</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>verdex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>highbank</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>akita</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>connex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>collie</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <acpi default='on' toggle='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='cris'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='i686'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>isapc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>microvm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='kvm'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <pae/>
Aug 09 19:13:23 user nova-compute[72441]:       <nonpae/>
Aug 09 19:13:23 user nova-compute[72441]:       <acpi default='on' toggle='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:       <apic default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='m68k'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>an5206</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>q800</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='microblaze'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='microblazeel'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='mips'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='16'>malta</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='mipsel'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='16'>malta</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='mips64'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='16'>malta</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>pica61</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>magnum</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='mips64el'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='16'>malta</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>pica61</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>magnum</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='16'>boston</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='ppc'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mac99</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>40p</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>taihu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='ppc64'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>taihu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>40p</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mac99</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='ppc64le'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>taihu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>40p</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>mac99</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='riscv32'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='8'>spike</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='8'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='riscv64'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='8'>spike</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='8'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='s390x'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='sh4'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>shix</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>r2d</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='sh4eb'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>shix</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>r2d</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='sparc'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>LX</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='sparc64'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>niagara</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='x86_64'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>64</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='1'>isapc</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>microvm</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='kvm'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <acpi default='on' toggle='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:       <apic default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='xtensa'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>sim</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>kc705</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ml605</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx200</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx60</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]:   <guest>
Aug 09 19:13:23 user nova-compute[72441]:     <os_type>hvm</os_type>
Aug 09 19:13:23 user nova-compute[72441]:     <arch name='xtensaeb'>
Aug 09 19:13:23 user nova-compute[72441]:       <wordsize>32</wordsize>
Aug 09 19:13:23 user nova-compute[72441]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='4'>sim</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>kc705</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ml605</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>virt</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx200</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>lx60</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 19:13:23 user nova-compute[72441]:       <domain type='qemu'/>
Aug 09 19:13:23 user nova-compute[72441]:     </arch>
Aug 09 19:13:23 user nova-compute[72441]:     <features>
Aug 09 19:13:23 user nova-compute[72441]:       <cpuselection/>
Aug 09 19:13:23 user nova-compute[72441]:       <deviceboot/>
Aug 09 19:13:23 user nova-compute[72441]:       <disksnapshot default='on' toggle='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     </features>
Aug 09 19:13:23 user nova-compute[72441]:   </guest>
Aug 09 19:13:23 user nova-compute[72441]: </capabilities>
Aug 09 19:13:23 user nova-compute[72441]: 
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-i440fx-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>i686</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='255'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'/>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='lm'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ide</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-q35-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>i686</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='288'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'/>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='lm'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-q35-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>i686</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='288'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'/>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='lm'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-i440fx-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>i686</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='255'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'/>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='lm'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ide</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-i440fx-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>x86_64</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='255'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>efi</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='invtsc'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='rsba'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ide</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-q35-jammy</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>x86_64</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='288'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>efi</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='invtsc'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='rsba'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-q35-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>x86_64</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='288'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>efi</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='invtsc'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='rsba'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 19:13:23 user nova-compute[72441]: <domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 19:13:23 user nova-compute[72441]:   <domain>kvm</domain>
Aug 09 19:13:23 user nova-compute[72441]:   <machine>pc-i440fx-6.2</machine>
Aug 09 19:13:23 user nova-compute[72441]:   <arch>x86_64</arch>
Aug 09 19:13:23 user nova-compute[72441]:   <vcpu max='255'/>
Aug 09 19:13:23 user nova-compute[72441]:   <iothreads supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:   <os supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='firmware'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>efi</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:     <loader supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>rom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pflash</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='readonly'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>yes</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='secure'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>no</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </loader>
Aug 09 19:13:23 user nova-compute[72441]:   </os>
Aug 09 19:13:23 user nova-compute[72441]:   <cpu>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-passthrough' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='hostPassthroughMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='maximum' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='maximumMigratable'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>on</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>off</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='host-model' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <vendor>Intel</vendor>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ss'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='vmx'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pcid'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='hypervisor'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arat'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='umip'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='md-clear'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='invtsc'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibpb'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='ibrs'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-stibp'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='rsba'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='erms'/>
Aug 09 19:13:23 user nova-compute[72441]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:     <mode name='custom' supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>qemu64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>qemu32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>phenom</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>pentium</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>n270</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm64</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>kvm32</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>coreduo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>core2duo</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>athlon</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Westmere</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Snowridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Skylake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>SandyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Penryn</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G5</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G4</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G3</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Opteron_G2</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Opteron_G1</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>IvyBridge</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Icelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Haswell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Rome</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-Milan</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>EPYC</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Dhyana</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cooperlake</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>Conroe</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='no'>Broadwell</model>
Aug 09 19:13:23 user nova-compute[72441]:       <model usable='yes'>486</model>
Aug 09 19:13:23 user nova-compute[72441]:     </mode>
Aug 09 19:13:23 user nova-compute[72441]:   </cpu>
Aug 09 19:13:23 user nova-compute[72441]:   <memoryBacking supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:     <enum name='sourceType'>
Aug 09 19:13:23 user nova-compute[72441]:       <value>file</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>anonymous</value>
Aug 09 19:13:23 user nova-compute[72441]:       <value>memfd</value>
Aug 09 19:13:23 user nova-compute[72441]:     </enum>
Aug 09 19:13:23 user nova-compute[72441]:   </memoryBacking>
Aug 09 19:13:23 user nova-compute[72441]:   <devices>
Aug 09 19:13:23 user nova-compute[72441]:     <disk supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='diskDevice'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>disk</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cdrom</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>floppy</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>lun</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='bus'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ide</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>fdc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sata</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </disk>
Aug 09 19:13:23 user nova-compute[72441]:     <graphics supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='type'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>sdl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vnc</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>spice</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egl-headless</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </graphics>
Aug 09 19:13:23 user nova-compute[72441]:     <video supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='modelType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>cirrus</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>vmvga</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>qxl</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>none</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>bochs</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>ramfb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </video>
Aug 09 19:13:23 user nova-compute[72441]:     <hostdev supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='mode'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>subsystem</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='startupPolicy'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>default</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>mandatory</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>requisite</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>optional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='subsysType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>usb</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>pci</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>scsi</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='capsType'/>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='pciBackend'/>
Aug 09 19:13:23 user nova-compute[72441]:     </hostdev>
Aug 09 19:13:23 user nova-compute[72441]:     <rng supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtio-non-transitional</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>random</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>egd</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>builtin</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </rng>
Aug 09 19:13:23 user nova-compute[72441]:     <filesystem supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='driverType'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>path</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>handle</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>virtiofs</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </filesystem>
Aug 09 19:13:23 user nova-compute[72441]:     <tpm supported='yes'>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='model'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-tis</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>tpm-crb</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:       <enum name='backendModel'>
Aug 09 19:13:23 user nova-compute[72441]:         <value>passthrough</value>
Aug 09 19:13:23 user nova-compute[72441]:         <value>emulator</value>
Aug 09 19:13:23 user nova-compute[72441]:       </enum>
Aug 09 19:13:23 user nova-compute[72441]:     </tpm>
Aug 09 19:13:23 user nova-compute[72441]:   </devices>
Aug 09 19:13:23 user nova-compute[72441]:   <features>
Aug 09 19:13:23 user nova-compute[72441]:     <gic supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:     <vmcoreinfo supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <genid supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backingStoreInput supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <backup supported='yes'/>
Aug 09 19:13:23 user nova-compute[72441]:     <sev supported='no'/>
Aug 09 19:13:23 user nova-compute[72441]:   </features>
Aug 09 19:13:23 user nova-compute[72441]: </domainCapabilities>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Checking secure boot support for host arch (x86_64) {{(pid=72441) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Checking secure boot support for host arch (x86_64) {{(pid=72441) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Checking secure boot support for host arch (x86_64) {{(pid=72441) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 19:13:23 user nova-compute[72441]: INFO nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Secure Boot support detected
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] cpu compare xml: <cpu match="exact">
Aug 09 19:13:23 user nova-compute[72441]:   <model>Nehalem</model>
Aug 09 19:13:23 user nova-compute[72441]: </cpu>
Aug 09 19:13:23 user nova-compute[72441]:  {{(pid=72441) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 19:13:23 user nova-compute[72441]: INFO nova.virt.node [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Generated node identity e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5
Aug 09 19:13:23 user nova-compute[72441]: INFO nova.virt.node [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Wrote node identity e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 to /opt/stack/data/nova/compute_id
Aug 09 19:13:23 user nova-compute[72441]: WARNING nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Compute nodes ['e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 19:13:23 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 19:13:23 user nova-compute[72441]: WARNING nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 19:13:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:13:23 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:13:23 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:13:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Hypervisor/Node resource view: name=user free_ram=10846MB free_disk=26.266326904296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:13:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:13:23 user nova-compute[72441]: WARNING nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] No compute node record for user:e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 could not be found.
Aug 09 19:13:23 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Compute node record created for user:user with uuid: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:13:24 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [req-a6039660-fc25-42e8-b90f-0572a3325ad8] Created resource provider record via placement API for resource provider with UUID e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 and name user.
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72441) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 19:13:24 user nova-compute[72441]: INFO nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] kernel doesn't support AMD SEV
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Libvirt baseline CPU <cpu>
Aug 09 19:13:24 user nova-compute[72441]:   <arch>x86_64</arch>
Aug 09 19:13:24 user nova-compute[72441]:   <model>Nehalem</model>
Aug 09 19:13:24 user nova-compute[72441]:   <vendor>Intel</vendor>
Aug 09 19:13:24 user nova-compute[72441]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 19:13:24 user nova-compute[72441]: </cpu>
Aug 09 19:13:24 user nova-compute[72441]:  {{(pid=72441) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Updated inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Updating resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 generation from 0 to 1 during operation: update_inventory {{(pid=72441) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Updating resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 generation from 1 to 2 during operation: update_traits {{(pid=72441) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.service [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Creating RPC server for service compute {{(pid=72441) start /opt/stack/nova/nova/service.py:182}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.service [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Join ServiceGroup membership for this service compute {{(pid=72441) start /opt/stack/nova/nova/service.py:199}}
Aug 09 19:13:24 user nova-compute[72441]: DEBUG nova.servicegroup.drivers.db [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72441) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 19:13:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:13:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:14:15 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:14:15 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=26.17000961303711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:14:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:15:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:15:16 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:15:16 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:15:16 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=10203MB free_disk=26.21471405029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:15:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:15:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:15:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:15:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:16:15 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:16:15 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=10209MB free_disk=25.98919677734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:16:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:16:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:18 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:16:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:16:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:16:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:17:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:17:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:17 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=9439MB free_disk=26.011863708496094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:17:17 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:17:18 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:18 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:17:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:17:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:17:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:17:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:17:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:23 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:23 user nova-compute[72441]: INFO nova.compute.claims [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Claim successful on node user
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Creating image(s)
Aug 09 19:17:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG nova.policy [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '554ea2267ce94d618fbd7ef211cb7b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d7a9e68495428292b9417ee4b234ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG nova.virt.images [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] 8b031dc4-f763-4336-82c2-c504ef7f23a0 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.part /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.part /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.converted" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:26 user nova-compute[72441]: INFO nova.compute.claims [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Claim successful on node user
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241.converted --force-share --output=json" returned: 0 in 0.127s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.404s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:26 user nova-compute[72441]: INFO oslo.privsep.daemon [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmo8v1orq/privsep.sock']
Aug 09 19:17:26 user sudo[81583]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmo8v1orq/privsep.sock
Aug 09 19:17:26 user sudo[81583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Creating image(s)
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "/opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "/opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:27 user nova-compute[72441]: DEBUG nova.policy [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3edb9b7ae08449295b41cba1f18b173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bd1f872607409cad378294c4b02051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Successfully created port: 67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:17:28 user sudo[81583]: pam_unix(sudo:session): session closed for user root
Aug 09 19:17:28 user nova-compute[72441]: INFO oslo.privsep.daemon [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Spawned new privsep daemon via rootwrap
Aug 09 19:17:28 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 19:17:28 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 19:17:28 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 19:17:28 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81586
Aug 09 19:17:28 user nova-compute[72441]: WARNING oslo_privsep.priv_context [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] privsep daemon already running
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.123s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Successfully created port: 00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk 1073741824" returned: 0 in 0.048s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.161s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk 1073741824" returned: 0 in 0.055s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Cannot resize image /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lazy-loading 'migration_context' on Instance uuid ae2500e5-b241-4a6b-a778-1e39fc49969c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Ensure instance console log exists: /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:17:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Cannot resize image /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'migration_context' on Instance uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Ensure instance console log exists: /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Successfully updated port: 00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquired lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:30 user nova-compute[72441]: INFO nova.compute.claims [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Claim successful on node user
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-changed-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Refreshing instance network info cache due to event network-changed-00cd85be-5bac-4024-85de-bf9e71aa8c62. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] Acquiring lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updating instance_info_cache with network_info: [{"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Releasing lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Instance network_info: |[{"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] Acquired lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.network.neutron [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Refreshing network info cache for port 00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Start _get_guest_xml network_info=[{"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:17:31 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:31 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1901637917',display_name='tempest-DeleteServersTestJSON-server-1901637917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1901637917',id=2,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bd1f872607409cad378294c4b02051',ramdisk_id='',reservation_id='r-h9w1bqwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1898791965',owner_user_name='tempest-DeleteServersTestJSON-1898791965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:27Z,user_data=None,user_id='c3edb9b7ae08449295b41cba1f18b173',uuid=ae2500e5-b241-4a6b-a778-1e39fc49969c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Converting VIF {"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lazy-loading 'pci_devices' on Instance uuid ae2500e5-b241-4a6b-a778-1e39fc49969c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:17:31 user nova-compute[72441]:   <uuid>ae2500e5-b241-4a6b-a778-1e39fc49969c</uuid>
Aug 09 19:17:31 user nova-compute[72441]:   <name>instance-00000002</name>
Aug 09 19:17:31 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:17:31 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:17:31 user nova-compute[72441]:   <metadata>
Aug 09 19:17:31 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:17:31 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:17:31 user nova-compute[72441]:       <nova:name>tempest-DeleteServersTestJSON-server-1901637917</nova:name>
Aug 09 19:17:31 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:17:31</nova:creationTime>
Aug 09 19:17:31 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:17:31 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:17:31 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:17:31 user nova-compute[72441]:       <nova:owner>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:user uuid="c3edb9b7ae08449295b41cba1f18b173">tempest-DeleteServersTestJSON-1898791965-project-member</nova:user>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:project uuid="f1bd1f872607409cad378294c4b02051">tempest-DeleteServersTestJSON-1898791965</nova:project>
Aug 09 19:17:31 user nova-compute[72441]:       </nova:owner>
Aug 09 19:17:31 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:17:31 user nova-compute[72441]:       <nova:ports>
Aug 09 19:17:31 user nova-compute[72441]:         <nova:port uuid="00cd85be-5bac-4024-85de-bf9e71aa8c62">
Aug 09 19:17:31 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:17:31 user nova-compute[72441]:         </nova:port>
Aug 09 19:17:31 user nova-compute[72441]:       </nova:ports>
Aug 09 19:17:31 user nova-compute[72441]:     </nova:instance>
Aug 09 19:17:31 user nova-compute[72441]:   </metadata>
Aug 09 19:17:31 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:17:31 user nova-compute[72441]:     <system>
Aug 09 19:17:31 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:17:31 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:17:31 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:17:31 user nova-compute[72441]:       <entry name="serial">ae2500e5-b241-4a6b-a778-1e39fc49969c</entry>
Aug 09 19:17:31 user nova-compute[72441]:       <entry name="uuid">ae2500e5-b241-4a6b-a778-1e39fc49969c</entry>
Aug 09 19:17:31 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:17:31 user nova-compute[72441]:     </system>
Aug 09 19:17:31 user nova-compute[72441]:   </sysinfo>
Aug 09 19:17:31 user nova-compute[72441]:   <os>
Aug 09 19:17:31 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:17:31 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:17:31 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:17:31 user nova-compute[72441]:   </os>
Aug 09 19:17:31 user nova-compute[72441]:   <features>
Aug 09 19:17:31 user nova-compute[72441]:     <acpi/>
Aug 09 19:17:31 user nova-compute[72441]:     <apic/>
Aug 09 19:17:31 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:17:31 user nova-compute[72441]:   </features>
Aug 09 19:17:31 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:17:31 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:17:31 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:17:31 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:17:31 user nova-compute[72441]:   </clock>
Aug 09 19:17:31 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:17:31 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:17:31 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:17:31 user nova-compute[72441]:   </cpu>
Aug 09 19:17:31 user nova-compute[72441]:   <devices>
Aug 09 19:17:31 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:17:31 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:17:31 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk"/>
Aug 09 19:17:31 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:17:31 user nova-compute[72441]:     </disk>
Aug 09 19:17:31 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:17:31 user nova-compute[72441]:       <mac address="fa:16:3e:f0:b5:de"/>
Aug 09 19:17:31 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:31 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:17:31 user nova-compute[72441]:       <target dev="tap00cd85be-5b"/>
Aug 09 19:17:31 user nova-compute[72441]:     </interface>
Aug 09 19:17:31 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:17:31 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/console.log" append="off"/>
Aug 09 19:17:31 user nova-compute[72441]:     </serial>
Aug 09 19:17:31 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:17:31 user nova-compute[72441]:     <video>
Aug 09 19:17:31 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:31 user nova-compute[72441]:     </video>
Aug 09 19:17:31 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:17:31 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:17:31 user nova-compute[72441]:     </rng>
Aug 09 19:17:31 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:17:31 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:17:31 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:17:31 user nova-compute[72441]:     </memballoon>
Aug 09 19:17:31 user nova-compute[72441]:   </devices>
Aug 09 19:17:31 user nova-compute[72441]: </domain>
Aug 09 19:17:31 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1901637917',display_name='tempest-DeleteServersTestJSON-server-1901637917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1901637917',id=2,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bd1f872607409cad378294c4b02051',ramdisk_id='',reservation_id='r-h9w1bqwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1898791965',owner_user_name='tempest-DeleteServersTestJSON-1898791965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:27Z,user_data=None,user_id='c3edb9b7ae08449295b41cba1f18b173',uuid=ae2500e5-b241-4a6b-a778-1e39fc49969c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Converting VIF {"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG os_vif [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.policy [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30843aacab5b4db3b76b43cf978bc721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae6d33400f3444387a69b9fc79e4b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Creating image(s)
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "/opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Created schema index Interface.name {{(pid=72441) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Created schema index Port.name {{(pid=72441) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Created schema index Bridge.name {{(pid=72441) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [POLLOUT] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:17:31 user nova-compute[72441]: INFO oslo.privsep.daemon [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp32bx6w84/privsep.sock']
Aug 09 19:17:31 user sudo[81630]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp32bx6w84/privsep.sock
Aug 09 19:17:31 user sudo[81630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk 1073741824" returned: 0 in 0.047s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Cannot resize image /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'migration_context' on Instance uuid 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Ensure instance console log exists: /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Successfully updated port: 67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updated VIF entry in instance network info cache for port 00cd85be-5bac-4024-85de-bf9e71aa8c62. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updating instance_info_cache with network_info: [{"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0765ec54-9b61-467b-a80c-f2ede90234d9 req-4c5bb096-4a98-4b05-bd34-aeae6df864ca service nova] Releasing lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-changed-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Refreshing instance network info cache due to event network-changed-67ae7f86-ce60-4d10-92a3-1f844312d497. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:17:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] Acquiring lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:33 user sudo[81630]: pam_unix(sudo:session): session closed for user root
Aug 09 19:17:33 user nova-compute[72441]: INFO oslo.privsep.daemon [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Spawned new privsep daemon via rootwrap
Aug 09 19:17:33 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 19:17:33 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 19:17:33 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 19:17:33 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81647
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Successfully created port: a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00cd85be-5b, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00cd85be-5b, col_values=(('external_ids', {'iface-id': '00cd85be-5bac-4024-85de-bf9e71aa8c62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:b5:de', 'vm-uuid': 'ae2500e5-b241-4a6b-a778-1e39fc49969c'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:33 user nova-compute[72441]: INFO os_vif [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b')
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] No VIF found with MAC fa:16:3e:f0:b5:de, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updating instance_info_cache with network_info: [{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Instance network_info: |[{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] Acquired lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Refreshing network info cache for port 67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Start _get_guest_xml network_info=[{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:17:33 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:33 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843939238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843939238',id=1,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-6535syke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:25Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=2ad9a2ce-9bab-4a99-b397-2fb64552efad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:17:33 user nova-compute[72441]:   <uuid>2ad9a2ce-9bab-4a99-b397-2fb64552efad</uuid>
Aug 09 19:17:33 user nova-compute[72441]:   <name>instance-00000001</name>
Aug 09 19:17:33 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:17:33 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:17:33 user nova-compute[72441]:   <metadata>
Aug 09 19:17:33 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:17:33 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:17:33 user nova-compute[72441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1843939238</nova:name>
Aug 09 19:17:33 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:17:33</nova:creationTime>
Aug 09 19:17:33 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:17:33 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:17:33 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:17:33 user nova-compute[72441]:       <nova:owner>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:user uuid="554ea2267ce94d618fbd7ef211cb7b51">tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member</nova:user>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:project uuid="e0d7a9e68495428292b9417ee4b234ad">tempest-ServerBootFromVolumeStableRescueTest-1993502489</nova:project>
Aug 09 19:17:33 user nova-compute[72441]:       </nova:owner>
Aug 09 19:17:33 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:17:33 user nova-compute[72441]:       <nova:ports>
Aug 09 19:17:33 user nova-compute[72441]:         <nova:port uuid="67ae7f86-ce60-4d10-92a3-1f844312d497">
Aug 09 19:17:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:17:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:17:33 user nova-compute[72441]:       </nova:ports>
Aug 09 19:17:33 user nova-compute[72441]:     </nova:instance>
Aug 09 19:17:33 user nova-compute[72441]:   </metadata>
Aug 09 19:17:33 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:17:33 user nova-compute[72441]:     <system>
Aug 09 19:17:33 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:17:33 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:17:33 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:17:33 user nova-compute[72441]:       <entry name="serial">2ad9a2ce-9bab-4a99-b397-2fb64552efad</entry>
Aug 09 19:17:33 user nova-compute[72441]:       <entry name="uuid">2ad9a2ce-9bab-4a99-b397-2fb64552efad</entry>
Aug 09 19:17:33 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:17:33 user nova-compute[72441]:     </system>
Aug 09 19:17:33 user nova-compute[72441]:   </sysinfo>
Aug 09 19:17:33 user nova-compute[72441]:   <os>
Aug 09 19:17:33 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:17:33 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:17:33 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:17:33 user nova-compute[72441]:   </os>
Aug 09 19:17:33 user nova-compute[72441]:   <features>
Aug 09 19:17:33 user nova-compute[72441]:     <acpi/>
Aug 09 19:17:33 user nova-compute[72441]:     <apic/>
Aug 09 19:17:33 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:17:33 user nova-compute[72441]:   </features>
Aug 09 19:17:33 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:17:33 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:17:33 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:17:33 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:17:33 user nova-compute[72441]:   </clock>
Aug 09 19:17:33 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:17:33 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:17:33 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:17:33 user nova-compute[72441]:   </cpu>
Aug 09 19:17:33 user nova-compute[72441]:   <devices>
Aug 09 19:17:33 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:17:33 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:17:33 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk"/>
Aug 09 19:17:33 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:17:33 user nova-compute[72441]:     </disk>
Aug 09 19:17:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:17:33 user nova-compute[72441]:       <mac address="fa:16:3e:b8:49:18"/>
Aug 09 19:17:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:17:33 user nova-compute[72441]:       <target dev="tap67ae7f86-ce"/>
Aug 09 19:17:33 user nova-compute[72441]:     </interface>
Aug 09 19:17:33 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:17:33 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/console.log" append="off"/>
Aug 09 19:17:33 user nova-compute[72441]:     </serial>
Aug 09 19:17:33 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:17:33 user nova-compute[72441]:     <video>
Aug 09 19:17:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:33 user nova-compute[72441]:     </video>
Aug 09 19:17:33 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:17:33 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:17:33 user nova-compute[72441]:     </rng>
Aug 09 19:17:33 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:17:33 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:17:33 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:17:33 user nova-compute[72441]:     </memballoon>
Aug 09 19:17:33 user nova-compute[72441]:   </devices>
Aug 09 19:17:33 user nova-compute[72441]: </domain>
Aug 09 19:17:33 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843939238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843939238',id=1,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-6535syke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:25Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=2ad9a2ce-9bab-4a99-b397-2fb64552efad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG os_vif [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67ae7f86-ce, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67ae7f86-ce, col_values=(('external_ids', {'iface-id': '67ae7f86-ce60-4d10-92a3-1f844312d497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:49:18', 'vm-uuid': '2ad9a2ce-9bab-4a99-b397-2fb64552efad'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:34 user nova-compute[72441]: INFO os_vif [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce')
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No VIF found with MAC fa:16:3e:b8:49:18, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:34 user nova-compute[72441]: INFO nova.compute.claims [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Claim successful on node user
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:35 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Creating image(s)
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.policy [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6d604b2b0d64d9285df9088ee2e8c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4775870464a74454992c156806470beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk 1073741824" returned: 0 in 0.171s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.131s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updated VIF entry in instance network info cache for port 67ae7f86-ce60-4d10-92a3-1f844312d497. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updating instance_info_cache with network_info: [{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Cannot resize image /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'migration_context' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c129dddc-7908-4441-8ac4-d17c221e23d9 req-9f54cd7b-8d85-47cf-a67a-61c731f18e56 service nova] Releasing lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Ensure instance console log exists: /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Successfully updated port: a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquired lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-changed-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Refreshing instance network info cache due to event network-changed-a225e308-07c0-4163-a087-b29c61623c4b. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] Acquiring lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Successfully created port: aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-045ffee3-7adb-4116-b728-1bdd91a9af2a req-2ba846dd-e82e-4621-971f-ac6098610167 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-045ffee3-7adb-4116-b728-1bdd91a9af2a req-2ba846dd-e82e-4621-971f-ac6098610167 service nova] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-045ffee3-7adb-4116-b728-1bdd91a9af2a req-2ba846dd-e82e-4621-971f-ac6098610167 service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-045ffee3-7adb-4116-b728-1bdd91a9af2a req-2ba846dd-e82e-4621-971f-ac6098610167 service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-045ffee3-7adb-4116-b728-1bdd91a9af2a req-2ba846dd-e82e-4621-971f-ac6098610167 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] No waiting events found dispatching network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:37 user nova-compute[72441]: WARNING nova.compute.manager [req-045ffee3-7adb-4116-b728-1bdd91a9af2a req-2ba846dd-e82e-4621-971f-ac6098610167 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received unexpected event network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 for instance with vm_state building and task_state spawning.
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updating instance_info_cache with network_info: [{"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Releasing lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Instance network_info: |[{"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] Acquired lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.neutron [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Refreshing network info cache for port a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Start _get_guest_xml network_info=[{"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-485f07dc-7983-4f65-bf4b-d4358f5b4f98 req-2847d5b1-838c-4a8f-a6ba-379686030db3 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-485f07dc-7983-4f65-bf4b-d4358f5b4f98 req-2847d5b1-838c-4a8f-a6ba-379686030db3 service nova] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-485f07dc-7983-4f65-bf4b-d4358f5b4f98 req-2847d5b1-838c-4a8f-a6ba-379686030db3 service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-485f07dc-7983-4f65-bf4b-d4358f5b4f98 req-2847d5b1-838c-4a8f-a6ba-379686030db3 service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-485f07dc-7983-4f65-bf4b-d4358f5b4f98 req-2847d5b1-838c-4a8f-a6ba-379686030db3 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] No waiting events found dispatching network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:37 user nova-compute[72441]: WARNING nova.compute.manager [req-485f07dc-7983-4f65-bf4b-d4358f5b4f98 req-2847d5b1-838c-4a8f-a6ba-379686030db3 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received unexpected event network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 for instance with vm_state building and task_state spawning.
Aug 09 19:17:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-379182093',display_name='tempest-AttachVolumeNegativeTest-server-379182093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-379182093',id=3,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI3z3ERYPKvVeABo/lMK8duv4oC2BP2dRc+73Hij9EIHJlvss/NstSNhO0+h4dk/F3U0HhTAhrsMm6pw5o3zHJM9shGdPbo3qbtJjrGuYa2/Fcwj3gx+uQab1KzWUYwrA==',key_name='tempest-keypair-280403461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-72nbprss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=32d57777-50e6-4fcb-b4e1-94b154e69f4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'pci_devices' on Instance uuid 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:17:37 user nova-compute[72441]:   <uuid>32d57777-50e6-4fcb-b4e1-94b154e69f4d</uuid>
Aug 09 19:17:37 user nova-compute[72441]:   <name>instance-00000003</name>
Aug 09 19:17:37 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:17:37 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:17:37 user nova-compute[72441]:   <metadata>
Aug 09 19:17:37 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:17:37 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:17:37 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-379182093</nova:name>
Aug 09 19:17:37 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:17:37</nova:creationTime>
Aug 09 19:17:37 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:17:37 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:17:37 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:17:37 user nova-compute[72441]:       <nova:owner>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:user uuid="30843aacab5b4db3b76b43cf978bc721">tempest-AttachVolumeNegativeTest-2037425419-project-member</nova:user>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:project uuid="8ae6d33400f3444387a69b9fc79e4b75">tempest-AttachVolumeNegativeTest-2037425419</nova:project>
Aug 09 19:17:37 user nova-compute[72441]:       </nova:owner>
Aug 09 19:17:37 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:17:37 user nova-compute[72441]:       <nova:ports>
Aug 09 19:17:37 user nova-compute[72441]:         <nova:port uuid="a225e308-07c0-4163-a087-b29c61623c4b">
Aug 09 19:17:37 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 19:17:37 user nova-compute[72441]:         </nova:port>
Aug 09 19:17:37 user nova-compute[72441]:       </nova:ports>
Aug 09 19:17:37 user nova-compute[72441]:     </nova:instance>
Aug 09 19:17:37 user nova-compute[72441]:   </metadata>
Aug 09 19:17:37 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:17:37 user nova-compute[72441]:     <system>
Aug 09 19:17:37 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:17:37 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:17:37 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:17:37 user nova-compute[72441]:       <entry name="serial">32d57777-50e6-4fcb-b4e1-94b154e69f4d</entry>
Aug 09 19:17:37 user nova-compute[72441]:       <entry name="uuid">32d57777-50e6-4fcb-b4e1-94b154e69f4d</entry>
Aug 09 19:17:37 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:17:37 user nova-compute[72441]:     </system>
Aug 09 19:17:37 user nova-compute[72441]:   </sysinfo>
Aug 09 19:17:37 user nova-compute[72441]:   <os>
Aug 09 19:17:37 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:17:37 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:17:37 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:17:37 user nova-compute[72441]:   </os>
Aug 09 19:17:37 user nova-compute[72441]:   <features>
Aug 09 19:17:37 user nova-compute[72441]:     <acpi/>
Aug 09 19:17:37 user nova-compute[72441]:     <apic/>
Aug 09 19:17:37 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:17:37 user nova-compute[72441]:   </features>
Aug 09 19:17:37 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:17:37 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:17:37 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:17:37 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:17:37 user nova-compute[72441]:   </clock>
Aug 09 19:17:37 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:17:37 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:17:37 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:17:37 user nova-compute[72441]:   </cpu>
Aug 09 19:17:37 user nova-compute[72441]:   <devices>
Aug 09 19:17:37 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:17:37 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:17:37 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk"/>
Aug 09 19:17:37 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:17:37 user nova-compute[72441]:     </disk>
Aug 09 19:17:37 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:17:37 user nova-compute[72441]:       <mac address="fa:16:3e:36:9f:8e"/>
Aug 09 19:17:37 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:37 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:17:37 user nova-compute[72441]:       <target dev="tapa225e308-07"/>
Aug 09 19:17:37 user nova-compute[72441]:     </interface>
Aug 09 19:17:37 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:17:37 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/console.log" append="off"/>
Aug 09 19:17:37 user nova-compute[72441]:     </serial>
Aug 09 19:17:37 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:17:37 user nova-compute[72441]:     <video>
Aug 09 19:17:37 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:37 user nova-compute[72441]:     </video>
Aug 09 19:17:37 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:17:37 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:17:37 user nova-compute[72441]:     </rng>
Aug 09 19:17:37 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:17:37 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:17:37 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:17:37 user nova-compute[72441]:     </memballoon>
Aug 09 19:17:37 user nova-compute[72441]:   </devices>
Aug 09 19:17:37 user nova-compute[72441]: </domain>
Aug 09 19:17:37 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-379182093',display_name='tempest-AttachVolumeNegativeTest-server-379182093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-379182093',id=3,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI3z3ERYPKvVeABo/lMK8duv4oC2BP2dRc+73Hij9EIHJlvss/NstSNhO0+h4dk/F3U0HhTAhrsMm6pw5o3zHJM9shGdPbo3qbtJjrGuYa2/Fcwj3gx+uQab1KzWUYwrA==',key_name='tempest-keypair-280403461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-72nbprss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=32d57777-50e6-4fcb-b4e1-94b154e69f4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG os_vif [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa225e308-07, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa225e308-07, col_values=(('external_ids', {'iface-id': 'a225e308-07c0-4163-a087-b29c61623c4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9f:8e', 'vm-uuid': '32d57777-50e6-4fcb-b4e1-94b154e69f4d'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:37 user nova-compute[72441]: INFO os_vif [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07')
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:36:9f:8e, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.network.neutron [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updated VIF entry in instance network info cache for port a225e308-07c0-4163-a087-b29c61623c4b. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.network.neutron [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updating instance_info_cache with network_info: [{"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608658.7132142, 2ad9a2ce-9bab-4a99-b397-2fb64552efad => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:38 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] VM Resumed (Lifecycle Event)
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4904a6b0-59ed-4b8c-940a-4ec01a37e4a9 req-0af56c73-70f3-4767-a994-a6cc44005277 service nova] Releasing lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Instance spawned successfully.
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:17:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Instance spawned successfully.
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:38 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608658.7154732, 2ad9a2ce-9bab-4a99-b397-2fb64552efad => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:38 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] VM Started (Lifecycle Event)
Aug 09 19:17:38 user nova-compute[72441]: INFO nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Took 12.02 seconds to spawn the instance on the hypervisor.
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:39 user nova-compute[72441]: INFO nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Took 14.23 seconds to spawn the instance on the hypervisor.
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608658.7344868, ae2500e5-b241-4a6b-a778-1e39fc49969c => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] VM Resumed (Lifecycle Event)
Aug 09 19:17:39 user nova-compute[72441]: INFO nova.compute.manager [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Took 12.99 seconds to build instance.
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ae4b7767-77ef-45ed-97d2-ee9ccdee4e65 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.160s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608658.7407465, ae2500e5-b241-4a6b-a778-1e39fc49969c => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] VM Started (Lifecycle Event)
Aug 09 19:17:39 user nova-compute[72441]: INFO nova.compute.manager [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Took 15.35 seconds to build instance.
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ea54d235-b5cb-4243-a547-e6e6fde4352d tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.546s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-92a7974a-655b-41bb-b6d7-02b1069c5c37 req-ad498389-aa8a-4075-a898-84d762132047 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-92a7974a-655b-41bb-b6d7-02b1069c5c37 req-ad498389-aa8a-4075-a898-84d762132047 service nova] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-92a7974a-655b-41bb-b6d7-02b1069c5c37 req-ad498389-aa8a-4075-a898-84d762132047 service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-92a7974a-655b-41bb-b6d7-02b1069c5c37 req-ad498389-aa8a-4075-a898-84d762132047 service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-92a7974a-655b-41bb-b6d7-02b1069c5c37 req-ad498389-aa8a-4075-a898-84d762132047 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] No waiting events found dispatching network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:39 user nova-compute[72441]: WARNING nova.compute.manager [req-92a7974a-655b-41bb-b6d7-02b1069c5c37 req-ad498389-aa8a-4075-a898-84d762132047 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received unexpected event network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 for instance with vm_state active and task_state None.
Aug 09 19:17:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-4709504a-3dac-4cf2-b018-2dcf615abfe0 req-7607f262-1dfd-4df5-b891-180e708e81ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4709504a-3dac-4cf2-b018-2dcf615abfe0 req-7607f262-1dfd-4df5-b891-180e708e81ca service nova] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4709504a-3dac-4cf2-b018-2dcf615abfe0 req-7607f262-1dfd-4df5-b891-180e708e81ca service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4709504a-3dac-4cf2-b018-2dcf615abfe0 req-7607f262-1dfd-4df5-b891-180e708e81ca service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-4709504a-3dac-4cf2-b018-2dcf615abfe0 req-7607f262-1dfd-4df5-b891-180e708e81ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] No waiting events found dispatching network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:39 user nova-compute[72441]: WARNING nova.compute.manager [req-4709504a-3dac-4cf2-b018-2dcf615abfe0 req-7607f262-1dfd-4df5-b891-180e708e81ca service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received unexpected event network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 for instance with vm_state active and task_state None.
Aug 09 19:17:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-985b1b4d-edbc-4528-beb3-98dbed4dfd20 req-7cfc9d0c-124d-4b91-afd8-98d608f1a001 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-985b1b4d-edbc-4528-beb3-98dbed4dfd20 req-7cfc9d0c-124d-4b91-afd8-98d608f1a001 service nova] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-985b1b4d-edbc-4528-beb3-98dbed4dfd20 req-7cfc9d0c-124d-4b91-afd8-98d608f1a001 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-985b1b4d-edbc-4528-beb3-98dbed4dfd20 req-7cfc9d0c-124d-4b91-afd8-98d608f1a001 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-985b1b4d-edbc-4528-beb3-98dbed4dfd20 req-7cfc9d0c-124d-4b91-afd8-98d608f1a001 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] No waiting events found dispatching network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:40 user nova-compute[72441]: WARNING nova.compute.manager [req-985b1b4d-edbc-4528-beb3-98dbed4dfd20 req-7cfc9d0c-124d-4b91-afd8-98d608f1a001 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received unexpected event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b for instance with vm_state building and task_state spawning.
Aug 09 19:17:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Successfully updated port: aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-changed-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Refreshing instance network info cache due to event network-changed-aae0b6a1-4106-4bbe-b283-e728f6dca34e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:17:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-5590dae7-4f51-4606-91ed-230be4e7c244 req-91586034-7ac2-439d-9726-d2714dc9ffe0 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5590dae7-4f51-4606-91ed-230be4e7c244 req-91586034-7ac2-439d-9726-d2714dc9ffe0 service nova] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5590dae7-4f51-4606-91ed-230be4e7c244 req-91586034-7ac2-439d-9726-d2714dc9ffe0 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5590dae7-4f51-4606-91ed-230be4e7c244 req-91586034-7ac2-439d-9726-d2714dc9ffe0 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-5590dae7-4f51-4606-91ed-230be4e7c244 req-91586034-7ac2-439d-9726-d2714dc9ffe0 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] No waiting events found dispatching network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:42 user nova-compute[72441]: WARNING nova.compute.manager [req-5590dae7-4f51-4606-91ed-230be4e7c244 req-91586034-7ac2-439d-9726-d2714dc9ffe0 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received unexpected event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b for instance with vm_state building and task_state spawning.
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608662.777327, 32d57777-50e6-4fcb-b4e1-94b154e69f4d => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:42 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] VM Resumed (Lifecycle Event)
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:17:42 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Instance spawned successfully.
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance network_info: |[{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.network.neutron [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Refreshing network info cache for port aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Start _get_guest_xml network_info=[{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:17:42 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608662.784477, 32d57777-50e6-4fcb-b4e1-94b154e69f4d => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:42 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] VM Started (Lifecycle Event)
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:42 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:42 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:17:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028222133',display_name='tempest-ServerActionsTestOtherA-server-1028222133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028222133',id=4,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1szv9zr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=822fd908-82ec-4e6c-bcab-b190213e67e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'pci_devices' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:43 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:17:43 user nova-compute[72441]: INFO nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Took 11.84 seconds to spawn the instance on the hypervisor.
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:17:43 user nova-compute[72441]:   <uuid>822fd908-82ec-4e6c-bcab-b190213e67e7</uuid>
Aug 09 19:17:43 user nova-compute[72441]:   <name>instance-00000004</name>
Aug 09 19:17:43 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:17:43 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:17:43 user nova-compute[72441]:   <metadata>
Aug 09 19:17:43 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:17:43 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:17:43 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherA-server-1028222133</nova:name>
Aug 09 19:17:43 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:17:42</nova:creationTime>
Aug 09 19:17:43 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:17:43 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:17:43 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:17:43 user nova-compute[72441]:       <nova:owner>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:user uuid="b6d604b2b0d64d9285df9088ee2e8c80">tempest-ServerActionsTestOtherA-683008927-project-member</nova:user>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:project uuid="4775870464a74454992c156806470beb">tempest-ServerActionsTestOtherA-683008927</nova:project>
Aug 09 19:17:43 user nova-compute[72441]:       </nova:owner>
Aug 09 19:17:43 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:17:43 user nova-compute[72441]:       <nova:ports>
Aug 09 19:17:43 user nova-compute[72441]:         <nova:port uuid="aae0b6a1-4106-4bbe-b283-e728f6dca34e">
Aug 09 19:17:43 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 19:17:43 user nova-compute[72441]:         </nova:port>
Aug 09 19:17:43 user nova-compute[72441]:       </nova:ports>
Aug 09 19:17:43 user nova-compute[72441]:     </nova:instance>
Aug 09 19:17:43 user nova-compute[72441]:   </metadata>
Aug 09 19:17:43 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:17:43 user nova-compute[72441]:     <system>
Aug 09 19:17:43 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:17:43 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:17:43 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:17:43 user nova-compute[72441]:       <entry name="serial">822fd908-82ec-4e6c-bcab-b190213e67e7</entry>
Aug 09 19:17:43 user nova-compute[72441]:       <entry name="uuid">822fd908-82ec-4e6c-bcab-b190213e67e7</entry>
Aug 09 19:17:43 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:17:43 user nova-compute[72441]:     </system>
Aug 09 19:17:43 user nova-compute[72441]:   </sysinfo>
Aug 09 19:17:43 user nova-compute[72441]:   <os>
Aug 09 19:17:43 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:17:43 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:17:43 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:17:43 user nova-compute[72441]:   </os>
Aug 09 19:17:43 user nova-compute[72441]:   <features>
Aug 09 19:17:43 user nova-compute[72441]:     <acpi/>
Aug 09 19:17:43 user nova-compute[72441]:     <apic/>
Aug 09 19:17:43 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:17:43 user nova-compute[72441]:   </features>
Aug 09 19:17:43 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:17:43 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:17:43 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:17:43 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:17:43 user nova-compute[72441]:   </clock>
Aug 09 19:17:43 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:17:43 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:17:43 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:17:43 user nova-compute[72441]:   </cpu>
Aug 09 19:17:43 user nova-compute[72441]:   <devices>
Aug 09 19:17:43 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:17:43 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:17:43 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk"/>
Aug 09 19:17:43 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:17:43 user nova-compute[72441]:     </disk>
Aug 09 19:17:43 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:17:43 user nova-compute[72441]:       <mac address="fa:16:3e:4a:6e:8f"/>
Aug 09 19:17:43 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:43 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:17:43 user nova-compute[72441]:       <target dev="tapaae0b6a1-41"/>
Aug 09 19:17:43 user nova-compute[72441]:     </interface>
Aug 09 19:17:43 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:17:43 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/console.log" append="off"/>
Aug 09 19:17:43 user nova-compute[72441]:     </serial>
Aug 09 19:17:43 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:17:43 user nova-compute[72441]:     <video>
Aug 09 19:17:43 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:43 user nova-compute[72441]:     </video>
Aug 09 19:17:43 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:17:43 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:17:43 user nova-compute[72441]:     </rng>
Aug 09 19:17:43 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:17:43 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:17:43 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:17:43 user nova-compute[72441]:     </memballoon>
Aug 09 19:17:43 user nova-compute[72441]:   </devices>
Aug 09 19:17:43 user nova-compute[72441]: </domain>
Aug 09 19:17:43 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028222133',display_name='tempest-ServerActionsTestOtherA-server-1028222133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028222133',id=4,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1szv9zr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=822fd908-82ec-4e6c-bcab-b190213e67e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG os_vif [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaae0b6a1-41, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaae0b6a1-41, col_values=(('external_ids', {'iface-id': 'aae0b6a1-4106-4bbe-b283-e728f6dca34e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:6e:8f', 'vm-uuid': '822fd908-82ec-4e6c-bcab-b190213e67e7'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:43 user nova-compute[72441]: INFO os_vif [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41')
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No VIF found with MAC fa:16:3e:4a:6e:8f, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:17:43 user nova-compute[72441]: INFO nova.compute.manager [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Took 12.90 seconds to build instance.
Aug 09 19:17:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4a549f55-0c83-4202-8466-873cc3ea7210 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.039s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updated VIF entry in instance network info cache for port aae0b6a1-4106-4bbe-b283-e728f6dca34e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f8ff4840-06a6-493c-b810-acadc9027e2c req-5f373c7a-870e-4e41-b2c7-b65a5bb83403 service nova] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b0a01115-afbd-4906-9fc0-2d952054c4d4 req-165e1d3c-2d77-4cf1-aa46-704d5a52c559 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b0a01115-afbd-4906-9fc0-2d952054c4d4 req-165e1d3c-2d77-4cf1-aa46-704d5a52c559 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b0a01115-afbd-4906-9fc0-2d952054c4d4 req-165e1d3c-2d77-4cf1-aa46-704d5a52c559 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b0a01115-afbd-4906-9fc0-2d952054c4d4 req-165e1d3c-2d77-4cf1-aa46-704d5a52c559 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b0a01115-afbd-4906-9fc0-2d952054c4d4 req-165e1d3c-2d77-4cf1-aa46-704d5a52c559 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:46 user nova-compute[72441]: WARNING nova.compute.manager [req-b0a01115-afbd-4906-9fc0-2d952054c4d4 req-165e1d3c-2d77-4cf1-aa46-704d5a52c559 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state building and task_state spawning.
Aug 09 19:17:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608668.443761, 822fd908-82ec-4e6c-bcab-b190213e67e7 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] VM Resumed (Lifecycle Event)
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance spawned successfully.
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608668.4448555, 822fd908-82ec-4e6c-bcab-b190213e67e7 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] VM Started (Lifecycle Event)
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-198799b5-4b51-4431-9bc4-79b1bfa70f31 req-db246127-5b71-4e8d-b970-779578b55f0c service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-198799b5-4b51-4431-9bc4-79b1bfa70f31 req-db246127-5b71-4e8d-b970-779578b55f0c service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-198799b5-4b51-4431-9bc4-79b1bfa70f31 req-db246127-5b71-4e8d-b970-779578b55f0c service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-198799b5-4b51-4431-9bc4-79b1bfa70f31 req-db246127-5b71-4e8d-b970-779578b55f0c service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-198799b5-4b51-4431-9bc4-79b1bfa70f31 req-db246127-5b71-4e8d-b970-779578b55f0c service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:48 user nova-compute[72441]: WARNING nova.compute.manager [req-198799b5-4b51-4431-9bc4-79b1bfa70f31 req-db246127-5b71-4e8d-b970-779578b55f0c service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state building and task_state spawning.
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Took 13.71 seconds to spawn the instance on the hypervisor.
Aug 09 19:17:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:17:48 user nova-compute[72441]: INFO nova.compute.manager [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Took 14.59 seconds to build instance.
Aug 09 19:17:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2e6a839f-f51e-422f-ace2-227f9a56db08 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.711s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:51 user nova-compute[72441]: INFO nova.compute.claims [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Claim successful on node user
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.629s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:51 user nova-compute[72441]: INFO nova.compute.claims [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Claim successful on node user
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.policy [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8c8b477c2d348c78e4ef1175a2b2c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f126de4ac5498786e47415c7e5ada4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:52 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Creating image(s)
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "/opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "/opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "/opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.218s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.235s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.893s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk 1073741824" returned: 0 in 0.091s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.network.neutron [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.188s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:17:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Cannot resize image /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'migration_context' on Instance uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.policy [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d535fe5da6438c8c1b30117a435d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34f86c5f5ff49198815f9b4b0e28cb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Successfully created port: 6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Ensure instance console log exists: /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Creating image(s)
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "/opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "/opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "/opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "5969779a8d65ff13c39336c9f30801fbee4257ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "5969779a8d65ff13c39336c9f30801fbee4257ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.part --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.virt.images [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] be36be2a-bd3c-4bd0-b8cb-e0bc984e55af was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.part /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.part /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.converted" returned: 0 in 0.175s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Successfully updated port: 6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-changed-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Refreshing instance network info cache due to event network-changed-6c0b584c-4d26-4bc9-826f-e776c4f6c43d. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] Acquiring lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] Acquired lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Refreshing network info cache for port 6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "5969779a8d65ff13c39336c9f30801fbee4257ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.143s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff --force-share --output=json" returned: 0 in 0.178s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "5969779a8d65ff13c39336c9f30801fbee4257ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "5969779a8d65ff13c39336c9f30801fbee4257ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG nova.network.neutron [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Successfully created port: 80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff,backing_fmt=raw /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff,backing_fmt=raw /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk 1073741824" returned: 0 in 0.066s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "5969779a8d65ff13c39336c9f30801fbee4257ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.neutron [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d76b7698-e020-4b5a-8b82-7b1013f95265 req-08248387-86d8-465c-97a7-a900504e288f service nova] Releasing lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquired lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff --force-share --output=json" returned: 0 in 0.189s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Cannot resize image /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lazy-loading 'migration_context' on Instance uuid b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Ensure instance console log exists: /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating instance_info_cache with network_info: [{"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Releasing lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Instance network_info: |[{"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Start _get_guest_xml network_info=[{"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:17:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-587874327',display_name='tempest-VolumesAdminNegativeTest-server-587874327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-587874327',id=5,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICMXcMVKHl99zKEPUeIbowufPTrg+Sajqf3DtAwPu525+xxBD5X9oGCduHdVv8t9XayvHhi1z4LeDKicWSaJhaBlkNkFHyF7BxVlY5HC3b2OAhjRs22BcWQRy+s+zj84A==',key_name='tempest-keypair-1198643854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f126de4ac5498786e47415c7e5ada4',ramdisk_id='',reservation_id='r-zvvi7qz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1423875380',owner_user_name='tempest-VolumesAdminNegativeTest-1423875380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8c8b477c2d348c78e4ef1175a2b2c09',uuid=bad8b180-4469-4439-8df9-188ec39a1314,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converting VIF {"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'pci_devices' on Instance uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:17:55 user nova-compute[72441]:   <uuid>bad8b180-4469-4439-8df9-188ec39a1314</uuid>
Aug 09 19:17:55 user nova-compute[72441]:   <name>instance-00000005</name>
Aug 09 19:17:55 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:17:55 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:17:55 user nova-compute[72441]:   <metadata>
Aug 09 19:17:55 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:17:55 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:17:55 user nova-compute[72441]:       <nova:name>tempest-VolumesAdminNegativeTest-server-587874327</nova:name>
Aug 09 19:17:55 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:17:55</nova:creationTime>
Aug 09 19:17:55 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:17:55 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:17:55 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:17:55 user nova-compute[72441]:       <nova:owner>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:user uuid="e8c8b477c2d348c78e4ef1175a2b2c09">tempest-VolumesAdminNegativeTest-1423875380-project-member</nova:user>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:project uuid="f9f126de4ac5498786e47415c7e5ada4">tempest-VolumesAdminNegativeTest-1423875380</nova:project>
Aug 09 19:17:55 user nova-compute[72441]:       </nova:owner>
Aug 09 19:17:55 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:17:55 user nova-compute[72441]:       <nova:ports>
Aug 09 19:17:55 user nova-compute[72441]:         <nova:port uuid="6c0b584c-4d26-4bc9-826f-e776c4f6c43d">
Aug 09 19:17:55 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:17:55 user nova-compute[72441]:         </nova:port>
Aug 09 19:17:55 user nova-compute[72441]:       </nova:ports>
Aug 09 19:17:55 user nova-compute[72441]:     </nova:instance>
Aug 09 19:17:55 user nova-compute[72441]:   </metadata>
Aug 09 19:17:55 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:17:55 user nova-compute[72441]:     <system>
Aug 09 19:17:55 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:17:55 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:17:55 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:17:55 user nova-compute[72441]:       <entry name="serial">bad8b180-4469-4439-8df9-188ec39a1314</entry>
Aug 09 19:17:55 user nova-compute[72441]:       <entry name="uuid">bad8b180-4469-4439-8df9-188ec39a1314</entry>
Aug 09 19:17:55 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:17:55 user nova-compute[72441]:     </system>
Aug 09 19:17:55 user nova-compute[72441]:   </sysinfo>
Aug 09 19:17:55 user nova-compute[72441]:   <os>
Aug 09 19:17:55 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:17:55 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:17:55 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:17:55 user nova-compute[72441]:   </os>
Aug 09 19:17:55 user nova-compute[72441]:   <features>
Aug 09 19:17:55 user nova-compute[72441]:     <acpi/>
Aug 09 19:17:55 user nova-compute[72441]:     <apic/>
Aug 09 19:17:55 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:17:55 user nova-compute[72441]:   </features>
Aug 09 19:17:55 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:17:55 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:17:55 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:17:55 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:17:55 user nova-compute[72441]:   </clock>
Aug 09 19:17:55 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:17:55 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:17:55 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:17:55 user nova-compute[72441]:   </cpu>
Aug 09 19:17:55 user nova-compute[72441]:   <devices>
Aug 09 19:17:55 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:17:55 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:17:55 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk"/>
Aug 09 19:17:55 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:17:55 user nova-compute[72441]:     </disk>
Aug 09 19:17:55 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:17:55 user nova-compute[72441]:       <mac address="fa:16:3e:b5:a7:be"/>
Aug 09 19:17:55 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:55 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:17:55 user nova-compute[72441]:       <target dev="tap6c0b584c-4d"/>
Aug 09 19:17:55 user nova-compute[72441]:     </interface>
Aug 09 19:17:55 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:17:55 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/console.log" append="off"/>
Aug 09 19:17:55 user nova-compute[72441]:     </serial>
Aug 09 19:17:55 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:17:55 user nova-compute[72441]:     <video>
Aug 09 19:17:55 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:55 user nova-compute[72441]:     </video>
Aug 09 19:17:55 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:17:55 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:17:55 user nova-compute[72441]:     </rng>
Aug 09 19:17:55 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:17:55 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:17:55 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:17:55 user nova-compute[72441]:     </memballoon>
Aug 09 19:17:55 user nova-compute[72441]:   </devices>
Aug 09 19:17:55 user nova-compute[72441]: </domain>
Aug 09 19:17:55 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-587874327',display_name='tempest-VolumesAdminNegativeTest-server-587874327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-587874327',id=5,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICMXcMVKHl99zKEPUeIbowufPTrg+Sajqf3DtAwPu525+xxBD5X9oGCduHdVv8t9XayvHhi1z4LeDKicWSaJhaBlkNkFHyF7BxVlY5HC3b2OAhjRs22BcWQRy+s+zj84A==',key_name='tempest-keypair-1198643854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f126de4ac5498786e47415c7e5ada4',ramdisk_id='',reservation_id='r-zvvi7qz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1423875380',owner_user_name='tempest-VolumesAdminNegativeTest-1423875380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8c8b477c2d348c78e4ef1175a2b2c09',uuid=bad8b180-4469-4439-8df9-188ec39a1314,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converting VIF {"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG os_vif [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c0b584c-4d, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c0b584c-4d, col_values=(('external_ids', {'iface-id': '6c0b584c-4d26-4bc9-826f-e776c4f6c43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:a7:be', 'vm-uuid': 'bad8b180-4469-4439-8df9-188ec39a1314'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:55 user nova-compute[72441]: INFO os_vif [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d')
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No VIF found with MAC fa:16:3e:b5:a7:be, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Successfully updated port: 80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquired lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-changed-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Refreshing instance network info cache due to event network-changed-80e491be-a99e-4cf8-bd82-79b34bcd10d3. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] Acquiring lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:17:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:17:58 user nova-compute[72441]: INFO nova.compute.claims [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Claim successful on node user
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f64afac-f0b1-486c-8ac6-acb4d1dd10fd req-06b583d3-46dc-4a8c-9be6-a448ae643290 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f64afac-f0b1-486c-8ac6-acb4d1dd10fd req-06b583d3-46dc-4a8c-9be6-a448ae643290 service nova] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f64afac-f0b1-486c-8ac6-acb4d1dd10fd req-06b583d3-46dc-4a8c-9be6-a448ae643290 service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f64afac-f0b1-486c-8ac6-acb4d1dd10fd req-06b583d3-46dc-4a8c-9be6-a448ae643290 service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f64afac-f0b1-486c-8ac6-acb4d1dd10fd req-06b583d3-46dc-4a8c-9be6-a448ae643290 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] No waiting events found dispatching network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:17:58 user nova-compute[72441]: WARNING nova.compute.manager [req-7f64afac-f0b1-486c-8ac6-acb4d1dd10fd req-06b583d3-46dc-4a8c-9be6-a448ae643290 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received unexpected event network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d for instance with vm_state building and task_state spawning.
Aug 09 19:17:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updating instance_info_cache with network_info: [{"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Releasing lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Instance network_info: |[{"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] Acquired lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.network.neutron [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Refreshing network info cache for port 80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Start _get_guest_xml network_info=[{"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:17:37Z,direct_url=<?>,disk_format='qcow2',id=be36be2a-bd3c-4bd0-b8cb-e0bc984e55af,min_disk=0,min_ram=0,name='',owner='e1d63aa9fe344d50b05b87c3bcd4d864',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:17:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'image_id': 'be36be2a-bd3c-4bd0-b8cb-e0bc984e55af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:17:58 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:58 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:17:37Z,direct_url=<?>,disk_format='qcow2',id=be36be2a-bd3c-4bd0-b8cb-e0bc984e55af,min_disk=0,min_ram=0,name='',owner='e1d63aa9fe344d50b05b87c3bcd4d864',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:17:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:17:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-316197828',display_name='tempest-AttachSCSIVolumeTestJSON-server-316197828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-316197828',id=6,image_ref='be36be2a-bd3c-4bd0-b8cb-e0bc984e55af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv2J7EvlLkd51qdl8ETMOJjqI+jqtfxltwPCS/zxYwCzBx9E91zwwcmjmcEJcMZo7VCSckEksGK0CAjByoVKE1esZPQR/JB6JN6UeGdxT7ThVDH/ac5K9S7QoFWGij7Gg==',key_name='tempest-keypair-1087709679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d34f86c5f5ff49198815f9b4b0e28cb5',ramdisk_id='',reservation_id='r-d3okxdgy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='be36be2a-bd3c-4bd0-b8cb-e0bc984e55af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-138532495',owner_user_name='tempest-AttachSCSIVolumeTestJSON-138532495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d535fe5da6438c8c1b30117a435d86',uuid=b171d9fc-ad55-486e-a500-39070470e1f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Converting VIF {"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lazy-loading 'pci_devices' on Instance uuid b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:17:59 user nova-compute[72441]:   <uuid>b171d9fc-ad55-486e-a500-39070470e1f1</uuid>
Aug 09 19:17:59 user nova-compute[72441]:   <name>instance-00000006</name>
Aug 09 19:17:59 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:17:59 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:17:59 user nova-compute[72441]:   <metadata>
Aug 09 19:17:59 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:17:59 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:17:59 user nova-compute[72441]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-316197828</nova:name>
Aug 09 19:17:59 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:17:58</nova:creationTime>
Aug 09 19:17:59 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:17:59 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:17:59 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:17:59 user nova-compute[72441]:       <nova:owner>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:user uuid="e4d535fe5da6438c8c1b30117a435d86">tempest-AttachSCSIVolumeTestJSON-138532495-project-member</nova:user>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:project uuid="d34f86c5f5ff49198815f9b4b0e28cb5">tempest-AttachSCSIVolumeTestJSON-138532495</nova:project>
Aug 09 19:17:59 user nova-compute[72441]:       </nova:owner>
Aug 09 19:17:59 user nova-compute[72441]:       <nova:root type="image" uuid="be36be2a-bd3c-4bd0-b8cb-e0bc984e55af"/>
Aug 09 19:17:59 user nova-compute[72441]:       <nova:ports>
Aug 09 19:17:59 user nova-compute[72441]:         <nova:port uuid="80e491be-a99e-4cf8-bd82-79b34bcd10d3">
Aug 09 19:17:59 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 19:17:59 user nova-compute[72441]:         </nova:port>
Aug 09 19:17:59 user nova-compute[72441]:       </nova:ports>
Aug 09 19:17:59 user nova-compute[72441]:     </nova:instance>
Aug 09 19:17:59 user nova-compute[72441]:   </metadata>
Aug 09 19:17:59 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:17:59 user nova-compute[72441]:     <system>
Aug 09 19:17:59 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:17:59 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:17:59 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:17:59 user nova-compute[72441]:       <entry name="serial">b171d9fc-ad55-486e-a500-39070470e1f1</entry>
Aug 09 19:17:59 user nova-compute[72441]:       <entry name="uuid">b171d9fc-ad55-486e-a500-39070470e1f1</entry>
Aug 09 19:17:59 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:17:59 user nova-compute[72441]:     </system>
Aug 09 19:17:59 user nova-compute[72441]:   </sysinfo>
Aug 09 19:17:59 user nova-compute[72441]:   <os>
Aug 09 19:17:59 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:17:59 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:17:59 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:17:59 user nova-compute[72441]:   </os>
Aug 09 19:17:59 user nova-compute[72441]:   <features>
Aug 09 19:17:59 user nova-compute[72441]:     <acpi/>
Aug 09 19:17:59 user nova-compute[72441]:     <apic/>
Aug 09 19:17:59 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:17:59 user nova-compute[72441]:   </features>
Aug 09 19:17:59 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:17:59 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:17:59 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:17:59 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:17:59 user nova-compute[72441]:   </clock>
Aug 09 19:17:59 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:17:59 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:17:59 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:17:59 user nova-compute[72441]:   </cpu>
Aug 09 19:17:59 user nova-compute[72441]:   <devices>
Aug 09 19:17:59 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:17:59 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:17:59 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk"/>
Aug 09 19:17:59 user nova-compute[72441]:       <target dev="sda" bus="scsi"/>
Aug 09 19:17:59 user nova-compute[72441]:       <address type="drive" controller="0" unit="0"/>
Aug 09 19:17:59 user nova-compute[72441]:     </disk>
Aug 09 19:17:59 user nova-compute[72441]:     <disk type="file" device="cdrom">
Aug 09 19:17:59 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 19:17:59 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.config"/>
Aug 09 19:17:59 user nova-compute[72441]:       <target dev="sdb" bus="scsi"/>
Aug 09 19:17:59 user nova-compute[72441]:       <address type="drive" controller="0" unit="1"/>
Aug 09 19:17:59 user nova-compute[72441]:     </disk>
Aug 09 19:17:59 user nova-compute[72441]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 19:17:59 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:17:59 user nova-compute[72441]:       <mac address="fa:16:3e:d9:5b:54"/>
Aug 09 19:17:59 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:59 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:17:59 user nova-compute[72441]:       <target dev="tap80e491be-a9"/>
Aug 09 19:17:59 user nova-compute[72441]:     </interface>
Aug 09 19:17:59 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:17:59 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/console.log" append="off"/>
Aug 09 19:17:59 user nova-compute[72441]:     </serial>
Aug 09 19:17:59 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:17:59 user nova-compute[72441]:     <video>
Aug 09 19:17:59 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:17:59 user nova-compute[72441]:     </video>
Aug 09 19:17:59 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:17:59 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:17:59 user nova-compute[72441]:     </rng>
Aug 09 19:17:59 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:17:59 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:17:59 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:17:59 user nova-compute[72441]:     </memballoon>
Aug 09 19:17:59 user nova-compute[72441]:   </devices>
Aug 09 19:17:59 user nova-compute[72441]: </domain>
Aug 09 19:17:59 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-316197828',display_name='tempest-AttachSCSIVolumeTestJSON-server-316197828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-316197828',id=6,image_ref='be36be2a-bd3c-4bd0-b8cb-e0bc984e55af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv2J7EvlLkd51qdl8ETMOJjqI+jqtfxltwPCS/zxYwCzBx9E91zwwcmjmcEJcMZo7VCSckEksGK0CAjByoVKE1esZPQR/JB6JN6UeGdxT7ThVDH/ac5K9S7QoFWGij7Gg==',key_name='tempest-keypair-1087709679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d34f86c5f5ff49198815f9b4b0e28cb5',ramdisk_id='',reservation_id='r-d3okxdgy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='be36be2a-bd3c-4bd0-b8cb-e0bc984e55af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-138532495',owner_user_name='tempest-AttachSCSIVolumeTestJSON-138532495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d535fe5da6438c8c1b30117a435d86',uuid=b171d9fc-ad55-486e-a500-39070470e1f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Converting VIF {"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG os_vif [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:17:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80e491be-a9, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80e491be-a9, col_values=(('external_ids', {'iface-id': '80e491be-a99e-4cf8-bd82-79b34bcd10d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5b:54', 'vm-uuid': 'b171d9fc-ad55-486e-a500-39070470e1f1'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:17:59 user nova-compute[72441]: INFO os_vif [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9')
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No BDM found with device name sda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No VIF found with MAC fa:16:3e:d9:5b:54, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:17:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Using config drive
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.policy [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f5c0e5f88ea40a3949d8ee0fc7f1f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e6e46a72e5405b8ac520a50439748f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:17:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Creating image(s)
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "/opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "/opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "/opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.199s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.neutron [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updated VIF entry in instance network info cache for port 80e491be-a99e-4cf8-bd82-79b34bcd10d3. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG nova.network.neutron [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updating instance_info_cache with network_info: [{"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.218s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-630221b3-00fa-480a-acb7-c3b1d516abd1 req-5e2de7b8-adef-45d4-83be-7bcbfe5d56a2 service nova] Releasing lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk 1073741824" returned: 0 in 0.061s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:17:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Creating config drive at /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.config
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbqdx644_ {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.233s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbqdx644_" returned: 0 in 0.101s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-1fdcb322-4d93-4029-b03a-4d4ec6b385fa req-644323ec-a4ae-4521-8700-7209b21de5f8 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fdcb322-4d93-4029-b03a-4d4ec6b385fa req-644323ec-a4ae-4521-8700-7209b21de5f8 service nova] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fdcb322-4d93-4029-b03a-4d4ec6b385fa req-644323ec-a4ae-4521-8700-7209b21de5f8 service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fdcb322-4d93-4029-b03a-4d4ec6b385fa req-644323ec-a4ae-4521-8700-7209b21de5f8 service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-1fdcb322-4d93-4029-b03a-4d4ec6b385fa req-644323ec-a4ae-4521-8700-7209b21de5f8 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] No waiting events found dispatching network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:00 user nova-compute[72441]: WARNING nova.compute.manager [req-1fdcb322-4d93-4029-b03a-4d4ec6b385fa req-644323ec-a4ae-4521-8700-7209b21de5f8 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received unexpected event network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d for instance with vm_state building and task_state spawning.
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Cannot resize image /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lazy-loading 'migration_context' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Ensure instance console log exists: /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608680.6338055, bad8b180-4469-4439-8df9-188ec39a1314 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] VM Resumed (Lifecycle Event)
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Instance spawned successfully.
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Successfully created port: daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608680.6340578, bad8b180-4469-4439-8df9-188ec39a1314 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] VM Started (Lifecycle Event)
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:00 user nova-compute[72441]: INFO nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Took 8.79 seconds to spawn the instance on the hypervisor.
Aug 09 19:18:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:01 user nova-compute[72441]: INFO nova.compute.manager [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Took 9.96 seconds to build instance.
Aug 09 19:18:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9911e272-fe50-424e-a3b7-a0c0ea59e8a3 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.178s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Successfully updated port: daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquired lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-changed-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Refreshing instance network info cache due to event network-changed-daa475e7-76ec-4a51-aee3-a9ad52871b5e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] Acquiring lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updating instance_info_cache with network_info: [{"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Releasing lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Instance network_info: |[{"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] Acquired lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Refreshing network info cache for port daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Start _get_guest_xml network_info=[{"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:02 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:02 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-463277449',display_name='tempest-VolumesAssistedSnapshotsTest-server-463277449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-463277449',id=7,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcMCMzI7xfmHOCT+PIzh21RWkNmzWcM88f9iKUa/09Ibre9vE99jgZd7ytcMo8yqa5STa+5EWL0DfSeZyYy17jrkz3zJPoun864MgKgAw4bRFdkuGY7DaaW4Y6mgzBAQQ==',key_name='tempest-keypair-84153918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72e6e46a72e5405b8ac520a50439748f',ramdisk_id='',reservation_id='r-sy5rux3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-513075373',owner_user_name='tempest-VolumesAssistedSnapshotsTest-513075373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f5c0e5f88ea40a3949d8ee0fc7f1f32',uuid=277c7588-02fc-4ccb-bdaa-085a6c95139d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Converting VIF {"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.objects.instance [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lazy-loading 'pci_devices' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:18:02 user nova-compute[72441]:   <uuid>277c7588-02fc-4ccb-bdaa-085a6c95139d</uuid>
Aug 09 19:18:02 user nova-compute[72441]:   <name>instance-00000007</name>
Aug 09 19:18:02 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:18:02 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:18:02 user nova-compute[72441]:   <metadata>
Aug 09 19:18:02 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:18:02 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:18:02 user nova-compute[72441]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-463277449</nova:name>
Aug 09 19:18:02 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:18:02</nova:creationTime>
Aug 09 19:18:02 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:18:02 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:18:02 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:18:02 user nova-compute[72441]:       <nova:owner>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:user uuid="2f5c0e5f88ea40a3949d8ee0fc7f1f32">tempest-VolumesAssistedSnapshotsTest-513075373-project-member</nova:user>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:project uuid="72e6e46a72e5405b8ac520a50439748f">tempest-VolumesAssistedSnapshotsTest-513075373</nova:project>
Aug 09 19:18:02 user nova-compute[72441]:       </nova:owner>
Aug 09 19:18:02 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:18:02 user nova-compute[72441]:       <nova:ports>
Aug 09 19:18:02 user nova-compute[72441]:         <nova:port uuid="daa475e7-76ec-4a51-aee3-a9ad52871b5e">
Aug 09 19:18:02 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:18:02 user nova-compute[72441]:         </nova:port>
Aug 09 19:18:02 user nova-compute[72441]:       </nova:ports>
Aug 09 19:18:02 user nova-compute[72441]:     </nova:instance>
Aug 09 19:18:02 user nova-compute[72441]:   </metadata>
Aug 09 19:18:02 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:18:02 user nova-compute[72441]:     <system>
Aug 09 19:18:02 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:18:02 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:18:02 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:18:02 user nova-compute[72441]:       <entry name="serial">277c7588-02fc-4ccb-bdaa-085a6c95139d</entry>
Aug 09 19:18:02 user nova-compute[72441]:       <entry name="uuid">277c7588-02fc-4ccb-bdaa-085a6c95139d</entry>
Aug 09 19:18:02 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:18:02 user nova-compute[72441]:     </system>
Aug 09 19:18:02 user nova-compute[72441]:   </sysinfo>
Aug 09 19:18:02 user nova-compute[72441]:   <os>
Aug 09 19:18:02 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:18:02 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:18:02 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:18:02 user nova-compute[72441]:   </os>
Aug 09 19:18:02 user nova-compute[72441]:   <features>
Aug 09 19:18:02 user nova-compute[72441]:     <acpi/>
Aug 09 19:18:02 user nova-compute[72441]:     <apic/>
Aug 09 19:18:02 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:18:02 user nova-compute[72441]:   </features>
Aug 09 19:18:02 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:18:02 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:18:02 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:18:02 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:18:02 user nova-compute[72441]:   </clock>
Aug 09 19:18:02 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:18:02 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:18:02 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:18:02 user nova-compute[72441]:   </cpu>
Aug 09 19:18:02 user nova-compute[72441]:   <devices>
Aug 09 19:18:02 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:18:02 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:18:02 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk"/>
Aug 09 19:18:02 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:18:02 user nova-compute[72441]:     </disk>
Aug 09 19:18:02 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:18:02 user nova-compute[72441]:       <mac address="fa:16:3e:36:65:cf"/>
Aug 09 19:18:02 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:18:02 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:18:02 user nova-compute[72441]:       <target dev="tapdaa475e7-76"/>
Aug 09 19:18:02 user nova-compute[72441]:     </interface>
Aug 09 19:18:02 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:18:02 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/console.log" append="off"/>
Aug 09 19:18:02 user nova-compute[72441]:     </serial>
Aug 09 19:18:02 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:18:02 user nova-compute[72441]:     <video>
Aug 09 19:18:02 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:18:02 user nova-compute[72441]:     </video>
Aug 09 19:18:02 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:18:02 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:18:02 user nova-compute[72441]:     </rng>
Aug 09 19:18:02 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:18:02 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:18:02 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:18:02 user nova-compute[72441]:     </memballoon>
Aug 09 19:18:02 user nova-compute[72441]:   </devices>
Aug 09 19:18:02 user nova-compute[72441]: </domain>
Aug 09 19:18:02 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-463277449',display_name='tempest-VolumesAssistedSnapshotsTest-server-463277449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-463277449',id=7,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcMCMzI7xfmHOCT+PIzh21RWkNmzWcM88f9iKUa/09Ibre9vE99jgZd7ytcMo8yqa5STa+5EWL0DfSeZyYy17jrkz3zJPoun864MgKgAw4bRFdkuGY7DaaW4Y6mgzBAQQ==',key_name='tempest-keypair-84153918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72e6e46a72e5405b8ac520a50439748f',ramdisk_id='',reservation_id='r-sy5rux3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-513075373',owner_user_name='tempest-VolumesAssistedSnapshotsTest-513075373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f5c0e5f88ea40a3949d8ee0fc7f1f32',uuid=277c7588-02fc-4ccb-bdaa-085a6c95139d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Converting VIF {"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG os_vif [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaa475e7-76, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaa475e7-76, col_values=(('external_ids', {'iface-id': 'daa475e7-76ec-4a51-aee3-a9ad52871b5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:65:cf', 'vm-uuid': '277c7588-02fc-4ccb-bdaa-085a6c95139d'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:18:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:02 user nova-compute[72441]: INFO os_vif [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76')
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] No VIF found with MAC fa:16:3e:36:65:cf, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:18:03 user nova-compute[72441]: INFO nova.compute.claims [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Claim successful on node user
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.network.neutron [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updated VIF entry in instance network info cache for port daa475e7-76ec-4a51-aee3-a9ad52871b5e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.network.neutron [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updating instance_info_cache with network_info: [{"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c06664f8-41f8-4811-9e32-d6e001493324 req-7a77dd11-4cd0-438d-bd25-940f669e9b08 service nova] Releasing lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:18:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:18:03 user nova-compute[72441]: DEBUG nova.policy [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adcc28c7b05f4da6ad35d196c5f338f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cda3a1fbad429cb93fbd8c3f0a21b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:18:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Creating image(s)
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "/opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "/opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.196s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] No waiting events found dispatching network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:04 user nova-compute[72441]: WARNING nova.compute.manager [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received unexpected event network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 for instance with vm_state building and task_state spawning.
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] No waiting events found dispatching network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:04 user nova-compute[72441]: WARNING nova.compute.manager [req-7208283b-1989-4561-ae98-06124f6674a2 req-6da6cc91-5382-4778-b605-ed7929b71bb8 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received unexpected event network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 for instance with vm_state building and task_state spawning.
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608684.5753088, b171d9fc-ad55-486e-a500-39070470e1f1 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:04 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] VM Resumed (Lifecycle Event)
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:18:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Instance spawned successfully.
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.206s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk 1073741824" returned: 0 in 0.104s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:05 user nova-compute[72441]: INFO nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Took 11.62 seconds to spawn the instance on the hypervisor.
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.302s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Successfully created port: 9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:18:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608684.5765302, b171d9fc-ad55-486e-a500-39070470e1f1 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] VM Started (Lifecycle Event)
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-1204a12e-3d18-49fb-94b1-5130b47a5164 req-d7caa3ea-f136-46cd-8206-e0dabcd587e8 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1204a12e-3d18-49fb-94b1-5130b47a5164 req-d7caa3ea-f136-46cd-8206-e0dabcd587e8 service nova] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1204a12e-3d18-49fb-94b1-5130b47a5164 req-d7caa3ea-f136-46cd-8206-e0dabcd587e8 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1204a12e-3d18-49fb-94b1-5130b47a5164 req-d7caa3ea-f136-46cd-8206-e0dabcd587e8 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-1204a12e-3d18-49fb-94b1-5130b47a5164 req-d7caa3ea-f136-46cd-8206-e0dabcd587e8 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] No waiting events found dispatching network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:05 user nova-compute[72441]: WARNING nova.compute.manager [req-1204a12e-3d18-49fb-94b1-5130b47a5164 req-d7caa3ea-f136-46cd-8206-e0dabcd587e8 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received unexpected event network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e for instance with vm_state building and task_state spawning.
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Cannot resize image /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lazy-loading 'migration_context' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Ensure instance console log exists: /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:05 user nova-compute[72441]: INFO nova.compute.manager [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Took 14.26 seconds to build instance.
Aug 09 19:18:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-522d1a6b-0dfa-45a1-b50d-209b98036fe2 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.417s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Successfully updated port: 9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquired lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-changed-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Refreshing instance network info cache due to event network-changed-9b55e52a-9733-4e1c-a2f5-75082680aa4d. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] Acquiring lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updating instance_info_cache with network_info: [{"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Releasing lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Instance network_info: |[{"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] Acquired lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Refreshing network info cache for port 9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Start _get_guest_xml network_info=[{"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-a4f7d869-97cb-496a-be84-08ea38532106 req-6d6e91f6-97d1-49f8-858e-e427c815c243 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a4f7d869-97cb-496a-be84-08ea38532106 req-6d6e91f6-97d1-49f8-858e-e427c815c243 service nova] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a4f7d869-97cb-496a-be84-08ea38532106 req-6d6e91f6-97d1-49f8-858e-e427c815c243 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a4f7d869-97cb-496a-be84-08ea38532106 req-6d6e91f6-97d1-49f8-858e-e427c815c243 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-a4f7d869-97cb-496a-be84-08ea38532106 req-6d6e91f6-97d1-49f8-858e-e427c815c243 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] No waiting events found dispatching network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:07 user nova-compute[72441]: WARNING nova.compute.manager [req-a4f7d869-97cb-496a-be84-08ea38532106 req-6d6e91f6-97d1-49f8-858e-e427c815c243 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received unexpected event network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e for instance with vm_state building and task_state spawning.
Aug 09 19:18:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-798529792',display_name='tempest-TestVolumeSwap-server-798529792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-798529792',id=8,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGf8Zo9RiUIYZ/+MsSpa7C0fjMvHDPohWBWmqOO4lMCiykTC1vruBC0LUD4kVGNNGEtkGD/TbBFhvEfE5DTnOWin7UI/Erh9YVWrQI67XlydgP8jUsz6AI8ZiH3oypxLA==',key_name='tempest-keypair-1540276229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cda3a1fbad429cb93fbd8c3f0a21b4',ramdisk_id='',reservation_id='r-95uv0ma0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-122912092',owner_user_name='tempest-TestVolumeSwap-122912092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:18:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adcc28c7b05f4da6ad35d196c5f338f0',uuid=ca5376e3-fc18-4583-8fbf-1ce8490ad767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Converting VIF {"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lazy-loading 'pci_devices' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:18:07 user nova-compute[72441]:   <uuid>ca5376e3-fc18-4583-8fbf-1ce8490ad767</uuid>
Aug 09 19:18:07 user nova-compute[72441]:   <name>instance-00000008</name>
Aug 09 19:18:07 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:18:07 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:18:07 user nova-compute[72441]:   <metadata>
Aug 09 19:18:07 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:18:07 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:18:07 user nova-compute[72441]:       <nova:name>tempest-TestVolumeSwap-server-798529792</nova:name>
Aug 09 19:18:07 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:18:07</nova:creationTime>
Aug 09 19:18:07 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:18:07 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:18:07 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:18:07 user nova-compute[72441]:       <nova:owner>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:user uuid="adcc28c7b05f4da6ad35d196c5f338f0">tempest-TestVolumeSwap-122912092-project-member</nova:user>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:project uuid="d8cda3a1fbad429cb93fbd8c3f0a21b4">tempest-TestVolumeSwap-122912092</nova:project>
Aug 09 19:18:07 user nova-compute[72441]:       </nova:owner>
Aug 09 19:18:07 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:18:07 user nova-compute[72441]:       <nova:ports>
Aug 09 19:18:07 user nova-compute[72441]:         <nova:port uuid="9b55e52a-9733-4e1c-a2f5-75082680aa4d">
Aug 09 19:18:07 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:18:07 user nova-compute[72441]:         </nova:port>
Aug 09 19:18:07 user nova-compute[72441]:       </nova:ports>
Aug 09 19:18:07 user nova-compute[72441]:     </nova:instance>
Aug 09 19:18:07 user nova-compute[72441]:   </metadata>
Aug 09 19:18:07 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:18:07 user nova-compute[72441]:     <system>
Aug 09 19:18:07 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:18:07 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:18:07 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:18:07 user nova-compute[72441]:       <entry name="serial">ca5376e3-fc18-4583-8fbf-1ce8490ad767</entry>
Aug 09 19:18:07 user nova-compute[72441]:       <entry name="uuid">ca5376e3-fc18-4583-8fbf-1ce8490ad767</entry>
Aug 09 19:18:07 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:18:07 user nova-compute[72441]:     </system>
Aug 09 19:18:07 user nova-compute[72441]:   </sysinfo>
Aug 09 19:18:07 user nova-compute[72441]:   <os>
Aug 09 19:18:07 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:18:07 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:18:07 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:18:07 user nova-compute[72441]:   </os>
Aug 09 19:18:07 user nova-compute[72441]:   <features>
Aug 09 19:18:07 user nova-compute[72441]:     <acpi/>
Aug 09 19:18:07 user nova-compute[72441]:     <apic/>
Aug 09 19:18:07 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:18:07 user nova-compute[72441]:   </features>
Aug 09 19:18:07 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:18:07 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:18:07 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:18:07 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:18:07 user nova-compute[72441]:   </clock>
Aug 09 19:18:07 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:18:07 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:18:07 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:18:07 user nova-compute[72441]:   </cpu>
Aug 09 19:18:07 user nova-compute[72441]:   <devices>
Aug 09 19:18:07 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:18:07 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:18:07 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk"/>
Aug 09 19:18:07 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:18:07 user nova-compute[72441]:     </disk>
Aug 09 19:18:07 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:18:07 user nova-compute[72441]:       <mac address="fa:16:3e:95:cd:a6"/>
Aug 09 19:18:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:18:07 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:18:07 user nova-compute[72441]:       <target dev="tap9b55e52a-97"/>
Aug 09 19:18:07 user nova-compute[72441]:     </interface>
Aug 09 19:18:07 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:18:07 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/console.log" append="off"/>
Aug 09 19:18:07 user nova-compute[72441]:     </serial>
Aug 09 19:18:07 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:18:07 user nova-compute[72441]:     <video>
Aug 09 19:18:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:18:07 user nova-compute[72441]:     </video>
Aug 09 19:18:07 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:18:07 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:18:07 user nova-compute[72441]:     </rng>
Aug 09 19:18:07 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:18:07 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:18:07 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:18:07 user nova-compute[72441]:     </memballoon>
Aug 09 19:18:07 user nova-compute[72441]:   </devices>
Aug 09 19:18:07 user nova-compute[72441]: </domain>
Aug 09 19:18:07 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-798529792',display_name='tempest-TestVolumeSwap-server-798529792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-798529792',id=8,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGf8Zo9RiUIYZ/+MsSpa7C0fjMvHDPohWBWmqOO4lMCiykTC1vruBC0LUD4kVGNNGEtkGD/TbBFhvEfE5DTnOWin7UI/Erh9YVWrQI67XlydgP8jUsz6AI8ZiH3oypxLA==',key_name='tempest-keypair-1540276229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cda3a1fbad429cb93fbd8c3f0a21b4',ramdisk_id='',reservation_id='r-95uv0ma0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-122912092',owner_user_name='tempest-TestVolumeSwap-122912092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:18:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adcc28c7b05f4da6ad35d196c5f338f0',uuid=ca5376e3-fc18-4583-8fbf-1ce8490ad767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Converting VIF {"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG os_vif [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b55e52a-97, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b55e52a-97, col_values=(('external_ids', {'iface-id': '9b55e52a-9733-4e1c-a2f5-75082680aa4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:cd:a6', 'vm-uuid': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:07 user nova-compute[72441]: INFO os_vif [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97')
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608687.6099758, 277c7588-02fc-4ccb-bdaa-085a6c95139d => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:07 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] VM Resumed (Lifecycle Event)
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:07 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Instance spawned successfully.
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] No VIF found with MAC fa:16:3e:95:cd:a6, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:07 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608687.6101882, 277c7588-02fc-4ccb-bdaa-085a6c95139d => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:07 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] VM Started (Lifecycle Event)
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:07 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:07 user nova-compute[72441]: INFO nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Took 8.50 seconds to spawn the instance on the hypervisor.
Aug 09 19:18:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updated VIF entry in instance network info cache for port 9b55e52a-9733-4e1c-a2f5-75082680aa4d. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:18:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updating instance_info_cache with network_info: [{"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:08 user nova-compute[72441]: INFO nova.compute.manager [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Took 9.95 seconds to build instance.
Aug 09 19:18:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1dad95fc-5039-4d6e-9870-e8f26f774116 req-a54b55a0-01d1-4d27-811e-b7ed2f5404ef service nova] Releasing lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-63e9eae0-238b-419d-b0b8-be5ad1aec1fe tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.418s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-11277a79-4075-4945-be63-54d2642e5c6f req-86367141-285c-4c5c-a89a-31cdfd2dd8b6 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-11277a79-4075-4945-be63-54d2642e5c6f req-86367141-285c-4c5c-a89a-31cdfd2dd8b6 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-11277a79-4075-4945-be63-54d2642e5c6f req-86367141-285c-4c5c-a89a-31cdfd2dd8b6 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-11277a79-4075-4945-be63-54d2642e5c6f req-86367141-285c-4c5c-a89a-31cdfd2dd8b6 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-11277a79-4075-4945-be63-54d2642e5c6f req-86367141-285c-4c5c-a89a-31cdfd2dd8b6 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:10 user nova-compute[72441]: WARNING nova.compute.manager [req-11277a79-4075-4945-be63-54d2642e5c6f req-86367141-285c-4c5c-a89a-31cdfd2dd8b6 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received unexpected event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with vm_state building and task_state spawning.
Aug 09 19:18:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-1272959f-8c9f-4183-b7f7-492d45b086a2 req-18e66f0b-645c-48b9-a3c6-fe8ec19313f2 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1272959f-8c9f-4183-b7f7-492d45b086a2 req-18e66f0b-645c-48b9-a3c6-fe8ec19313f2 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1272959f-8c9f-4183-b7f7-492d45b086a2 req-18e66f0b-645c-48b9-a3c6-fe8ec19313f2 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1272959f-8c9f-4183-b7f7-492d45b086a2 req-18e66f0b-645c-48b9-a3c6-fe8ec19313f2 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-1272959f-8c9f-4183-b7f7-492d45b086a2 req-18e66f0b-645c-48b9-a3c6-fe8ec19313f2 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:12 user nova-compute[72441]: WARNING nova.compute.manager [req-1272959f-8c9f-4183-b7f7-492d45b086a2 req-18e66f0b-645c-48b9-a3c6-fe8ec19313f2 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received unexpected event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with vm_state building and task_state spawning.
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608692.3227463, ca5376e3-fc18-4583-8fbf-1ce8490ad767 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] VM Resumed (Lifecycle Event)
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Instance spawned successfully.
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608692.323159, ca5376e3-fc18-4583-8fbf-1ce8490ad767 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] VM Started (Lifecycle Event)
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:12 user nova-compute[72441]: INFO nova.compute.manager [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Took 9.59 seconds to build instance.
Aug 09 19:18:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b1b77ba7-5946-4eea-8860-82678f592fc4 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.846s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:18:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:18:14 user nova-compute[72441]: INFO nova.compute.claims [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Claim successful on node user
Aug 09 19:18:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:18:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.policy [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7860ae33a374a1bb6b02f4523c82918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf07d0d151b94d1b8ebd3fe99050b6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:18:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Creating image(s)
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "/opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "/opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk 1073741824" returned: 0 in 0.055s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Successfully created port: 3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Cannot resize image /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lazy-loading 'migration_context' on Instance uuid 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Ensure instance console log exists: /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Successfully updated port: 3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "refresh_cache-8ea4bb2e-23b4-4401-a509-8d4b5ed03247" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquired lock "refresh_cache-8ea4bb2e-23b4-4401-a509-8d4b5ed03247" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-changed-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Refreshing instance network info cache due to event network-changed-3bd80bef-7714-44dd-a171-7273d87c938c. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] Acquiring lock "refresh_cache-8ea4bb2e-23b4-4401-a509-8d4b5ed03247" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Updating instance_info_cache with network_info: [{"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Releasing lock "refresh_cache-8ea4bb2e-23b4-4401-a509-8d4b5ed03247" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Instance network_info: |[{"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] Acquired lock "refresh_cache-8ea4bb2e-23b4-4401-a509-8d4b5ed03247" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.neutron [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Refreshing network info cache for port 3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Start _get_guest_xml network_info=[{"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:18:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1948542462',display_name='tempest-VolumesActionsTest-instance-1948542462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1948542462',id=9,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf07d0d151b94d1b8ebd3fe99050b6bb',ramdisk_id='',reservation_id='r-uyye35pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1935143134',owner_user_name='tempest-VolumesActionsTest-1935143134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:18:15Z,user_data=None,user_id='b7860ae33a374a1bb6b02f4523c82918',uuid=8ea4bb2e-23b4-4401-a509-8d4b5ed03247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Converting VIF {"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:18:17 user nova-compute[72441]:   <uuid>8ea4bb2e-23b4-4401-a509-8d4b5ed03247</uuid>
Aug 09 19:18:17 user nova-compute[72441]:   <name>instance-00000009</name>
Aug 09 19:18:17 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:18:17 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:18:17 user nova-compute[72441]:   <metadata>
Aug 09 19:18:17 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:18:17 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:18:17 user nova-compute[72441]:       <nova:name>tempest-VolumesActionsTest-instance-1948542462</nova:name>
Aug 09 19:18:17 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:18:17</nova:creationTime>
Aug 09 19:18:17 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:18:17 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:18:17 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:18:17 user nova-compute[72441]:       <nova:owner>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:user uuid="b7860ae33a374a1bb6b02f4523c82918">tempest-VolumesActionsTest-1935143134-project-member</nova:user>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:project uuid="cf07d0d151b94d1b8ebd3fe99050b6bb">tempest-VolumesActionsTest-1935143134</nova:project>
Aug 09 19:18:17 user nova-compute[72441]:       </nova:owner>
Aug 09 19:18:17 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:18:17 user nova-compute[72441]:       <nova:ports>
Aug 09 19:18:17 user nova-compute[72441]:         <nova:port uuid="3bd80bef-7714-44dd-a171-7273d87c938c">
Aug 09 19:18:17 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:18:17 user nova-compute[72441]:         </nova:port>
Aug 09 19:18:17 user nova-compute[72441]:       </nova:ports>
Aug 09 19:18:17 user nova-compute[72441]:     </nova:instance>
Aug 09 19:18:17 user nova-compute[72441]:   </metadata>
Aug 09 19:18:17 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:18:17 user nova-compute[72441]:     <system>
Aug 09 19:18:17 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:18:17 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:18:17 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:18:17 user nova-compute[72441]:       <entry name="serial">8ea4bb2e-23b4-4401-a509-8d4b5ed03247</entry>
Aug 09 19:18:17 user nova-compute[72441]:       <entry name="uuid">8ea4bb2e-23b4-4401-a509-8d4b5ed03247</entry>
Aug 09 19:18:17 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:18:17 user nova-compute[72441]:     </system>
Aug 09 19:18:17 user nova-compute[72441]:   </sysinfo>
Aug 09 19:18:17 user nova-compute[72441]:   <os>
Aug 09 19:18:17 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:18:17 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:18:17 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:18:17 user nova-compute[72441]:   </os>
Aug 09 19:18:17 user nova-compute[72441]:   <features>
Aug 09 19:18:17 user nova-compute[72441]:     <acpi/>
Aug 09 19:18:17 user nova-compute[72441]:     <apic/>
Aug 09 19:18:17 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:18:17 user nova-compute[72441]:   </features>
Aug 09 19:18:17 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:18:17 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:18:17 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:18:17 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:18:17 user nova-compute[72441]:   </clock>
Aug 09 19:18:17 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:18:17 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:18:17 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:18:17 user nova-compute[72441]:   </cpu>
Aug 09 19:18:17 user nova-compute[72441]:   <devices>
Aug 09 19:18:17 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:18:17 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:18:17 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk"/>
Aug 09 19:18:17 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:18:17 user nova-compute[72441]:     </disk>
Aug 09 19:18:17 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:18:17 user nova-compute[72441]:       <mac address="fa:16:3e:47:46:10"/>
Aug 09 19:18:17 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:18:17 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:18:17 user nova-compute[72441]:       <target dev="tap3bd80bef-77"/>
Aug 09 19:18:17 user nova-compute[72441]:     </interface>
Aug 09 19:18:17 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:18:17 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/console.log" append="off"/>
Aug 09 19:18:17 user nova-compute[72441]:     </serial>
Aug 09 19:18:17 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:18:17 user nova-compute[72441]:     <video>
Aug 09 19:18:17 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:18:17 user nova-compute[72441]:     </video>
Aug 09 19:18:17 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:18:17 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:18:17 user nova-compute[72441]:     </rng>
Aug 09 19:18:17 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:18:17 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:18:17 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:18:17 user nova-compute[72441]:     </memballoon>
Aug 09 19:18:17 user nova-compute[72441]:   </devices>
Aug 09 19:18:17 user nova-compute[72441]: </domain>
Aug 09 19:18:17 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1948542462',display_name='tempest-VolumesActionsTest-instance-1948542462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1948542462',id=9,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf07d0d151b94d1b8ebd3fe99050b6bb',ramdisk_id='',reservation_id='r-uyye35pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1935143134',owner_user_name='tempest-VolumesActionsTest-1935143134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:18:15Z,user_data=None,user_id='b7860ae33a374a1bb6b02f4523c82918',uuid=8ea4bb2e-23b4-4401-a509-8d4b5ed03247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Converting VIF {"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG os_vif [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bd80bef-77, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bd80bef-77, col_values=(('external_ids', {'iface-id': '3bd80bef-7714-44dd-a171-7273d87c938c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:46:10', 'vm-uuid': '8ea4bb2e-23b4-4401-a509-8d4b5ed03247'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:17 user nova-compute[72441]: INFO os_vif [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77')
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:18:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] No VIF found with MAC fa:16:3e:47:46:10, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:18:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Updated VIF entry in instance network info cache for port 3bd80bef-7714-44dd-a171-7273d87c938c. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:18:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Updating instance_info_cache with network_info: [{"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a197614-dbbc-4961-9bc5-96e5f7aa4278 req-424d5a40-3b1c-42d9-803b-89cd04689227 service nova] Releasing lock "refresh_cache-8ea4bb2e-23b4-4401-a509-8d4b5ed03247" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:18 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:18 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe17a1df-0666-41a4-9d1c-9b4901f97386 req-35da84b5-3aec-4c59-b6b7-4734a9424df1 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe17a1df-0666-41a4-9d1c-9b4901f97386 req-35da84b5-3aec-4c59-b6b7-4734a9424df1 service nova] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe17a1df-0666-41a4-9d1c-9b4901f97386 req-35da84b5-3aec-4c59-b6b7-4734a9424df1 service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe17a1df-0666-41a4-9d1c-9b4901f97386 req-35da84b5-3aec-4c59-b6b7-4734a9424df1 service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe17a1df-0666-41a4-9d1c-9b4901f97386 req-35da84b5-3aec-4c59-b6b7-4734a9424df1 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] No waiting events found dispatching network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:19 user nova-compute[72441]: WARNING nova.compute.manager [req-fe17a1df-0666-41a4-9d1c-9b4901f97386 req-35da84b5-3aec-4c59-b6b7-4734a9424df1 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received unexpected event network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c for instance with vm_state building and task_state spawning.
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:18:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-32839e16-ce95-4e53-a54a-1aea3f22e039 req-51499d75-4c5f-4955-ab24-dac38e65c26c service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-32839e16-ce95-4e53-a54a-1aea3f22e039 req-51499d75-4c5f-4955-ab24-dac38e65c26c service nova] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-32839e16-ce95-4e53-a54a-1aea3f22e039 req-51499d75-4c5f-4955-ab24-dac38e65c26c service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-32839e16-ce95-4e53-a54a-1aea3f22e039 req-51499d75-4c5f-4955-ab24-dac38e65c26c service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-32839e16-ce95-4e53-a54a-1aea3f22e039 req-51499d75-4c5f-4955-ab24-dac38e65c26c service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] No waiting events found dispatching network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:18:21 user nova-compute[72441]: WARNING nova.compute.manager [req-32839e16-ce95-4e53-a54a-1aea3f22e039 req-51499d75-4c5f-4955-ab24-dac38e65c26c service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received unexpected event network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c for instance with vm_state building and task_state spawning.
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608701.7474015, 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:21 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] VM Resumed (Lifecycle Event)
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Instance spawned successfully.
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:21 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608701.7864368, 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:18:21 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] VM Started (Lifecycle Event)
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:21 user nova-compute[72441]: INFO nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 09 19:18:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:18:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:18:22 user nova-compute[72441]: INFO nova.compute.manager [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Took 7.43 seconds to build instance.
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1c69f02f-1fde-4efa-a368-1bf017ce48e3 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.591s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:18:23 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:23 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=25.71822738647461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ae2500e5-b241-4a6b-a778-1e39fc49969c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bad8b180-4469-4439-8df9-188ec39a1314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b171d9fc-ad55-486e-a500-39070470e1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 277c7588-02fc-4ccb-bdaa-085a6c95139d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:18:23 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:18:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:18:24 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:18:24 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:18:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.907s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:18:25 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:18:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updating instance_info_cache with network_info: [{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:18:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:18:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:18:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:18:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:18:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:19:02 user nova-compute[72441]: INFO nova.compute.claims [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Claim successful on node user
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:19:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.617s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:19:03 user nova-compute[72441]: INFO nova.compute.claims [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Claim successful on node user
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:19:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:19:03 user nova-compute[72441]: INFO nova.virt.block_device [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Booting with volume 11e433a2-c74b-42df-af90-fae220b7d38c at /dev/vda
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.policy [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a776dda4e2fd41488650a91c885777f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cd7982c3241a6bf75a76a8c9674bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG os_brick.utils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:03 user nova-compute[72441]: INFO oslo.privsep.daemon [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxxgu2y18/privsep.sock']
Aug 09 19:19:03 user sudo[83502]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxxgu2y18/privsep.sock
Aug 09 19:19:03 user sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.938s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:03 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:19:03 user nova-compute[72441]: INFO nova.compute.claims [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Claim successful on node user
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:19:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:19:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Creating image(s)
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "/opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "/opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "/opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.policy [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05fef9049d74ab4bb3720dda72aae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ef2ebdb8d24c9fa1fd12ea4b1c3dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk 1073741824" returned: 0 in 0.050s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:19:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.policy [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ba704de696a49258532080173d23fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2820770744df88c94474a2ad02e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully created port: 9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:19:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Creating image(s)
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "95031734c188babccf33b2d0e4fc74cc9914b3d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "95031734c188babccf33b2d0e4fc74cc9914b3d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Cannot resize image /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lazy-loading 'migration_context' on Instance uuid 618721bf-b744-4fb7-b2b9-9972d50f15ca {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Ensure instance console log exists: /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Successfully created port: ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully created port: 099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Successfully created port: 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.part --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.virt.images [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] 32e95858-7fe3-43aa-bce7-59edbd58d401 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.part /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user sudo[83502]: pam_unix(sudo:session): session closed for user root
Aug 09 19:19:05 user nova-compute[72441]: INFO oslo.privsep.daemon [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Spawned new privsep daemon via rootwrap
Aug 09 19:19:05 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 19:19:05 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 19:19:05 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 19:19:05 user nova-compute[72441]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83536
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f022d4-0a75-48a1-b13a-c6939d4ca7a8]: (2,) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.part /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.converted" returned: 0 in 0.176s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "95031734c188babccf33b2d0e4fc74cc9914b3d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.913s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[615fd82b-5c54-4ce4-b266-078261364b2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:05 user nova-compute[72441]: WARNING os_brick.initiator.connectors.nvmeof [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375dd37-0692-4739-a23c-9131c5e607f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e738e-167f-4517-a49d-ecaac91c04a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff5a9c-eb25-4ad2-bc53-229096fa400d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:05 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41bf6c2-99fe-4ca7-9dfb-ed0277126d57]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG os_brick.utils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== get_connector_properties: return (2088ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating existing volume attachment record: 8e146c24-37c7-4701-9633-0b66fdd3e0d3 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully created port: 0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json" returned: 0 in 0.166s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "95031734c188babccf33b2d0e4fc74cc9914b3d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "95031734c188babccf33b2d0e4fc74cc9914b3d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7,backing_fmt=raw /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Successfully updated port: ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7,backing_fmt=raw /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk 1073741824" returned: 0 in 0.055s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "95031734c188babccf33b2d0e4fc74cc9914b3d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Successfully updated port: 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "refresh_cache-618721bf-b744-4fb7-b2b9-9972d50f15ca" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquired lock "refresh_cache-618721bf-b744-4fb7-b2b9-9972d50f15ca" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-changed-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Refreshing instance network info cache due to event network-changed-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] Acquiring lock "refresh_cache-618721bf-b744-4fb7-b2b9-9972d50f15ca" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-changed-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing instance network info cache due to event network-changed-01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing network info cache for port 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Cannot resize image /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'migration_context' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Ensure instance console log exists: /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully created port: 2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Updating instance_info_cache with network_info: [{"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Releasing lock "refresh_cache-618721bf-b744-4fb7-b2b9-9972d50f15ca" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Instance network_info: |[{"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] Acquired lock "refresh_cache-618721bf-b744-4fb7-b2b9-9972d50f15ca" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Refreshing network info cache for port ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Start _get_guest_xml network_info=[{"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:19:06 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:06 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-454392256',display_name='tempest-VolumesNegativeTest-instance-454392256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-454392256',id=11,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7ef2ebdb8d24c9fa1fd12ea4b1c3dd1',ramdisk_id='',reservation_id='r-abl7w6mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-201219142',owner_user_name='tempest-VolumesNegativeTest-201219142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data=None,user_id='f05fef9049d74ab4bb3720dda72aae89',uuid=618721bf-b744-4fb7-b2b9-9972d50f15ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Converting VIF {"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lazy-loading 'pci_devices' on Instance uuid 618721bf-b744-4fb7-b2b9-9972d50f15ca {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:19:06 user nova-compute[72441]:   <uuid>618721bf-b744-4fb7-b2b9-9972d50f15ca</uuid>
Aug 09 19:19:06 user nova-compute[72441]:   <name>instance-0000000b</name>
Aug 09 19:19:06 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:19:06 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:19:06 user nova-compute[72441]:   <metadata>
Aug 09 19:19:06 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:19:06 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:19:06 user nova-compute[72441]:       <nova:name>tempest-VolumesNegativeTest-instance-454392256</nova:name>
Aug 09 19:19:06 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:19:06</nova:creationTime>
Aug 09 19:19:06 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:19:06 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:19:06 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:19:06 user nova-compute[72441]:       <nova:owner>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:user uuid="f05fef9049d74ab4bb3720dda72aae89">tempest-VolumesNegativeTest-201219142-project-member</nova:user>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:project uuid="a7ef2ebdb8d24c9fa1fd12ea4b1c3dd1">tempest-VolumesNegativeTest-201219142</nova:project>
Aug 09 19:19:06 user nova-compute[72441]:       </nova:owner>
Aug 09 19:19:06 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:19:06 user nova-compute[72441]:       <nova:ports>
Aug 09 19:19:06 user nova-compute[72441]:         <nova:port uuid="ce22d1a0-a218-4bb2-ba1c-c2a7f949e446">
Aug 09 19:19:06 user nova-compute[72441]:           <nova:ip type="fixed" address="192.168.233.119" ipVersion="4"/>
Aug 09 19:19:06 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:06 user nova-compute[72441]:       </nova:ports>
Aug 09 19:19:06 user nova-compute[72441]:     </nova:instance>
Aug 09 19:19:06 user nova-compute[72441]:   </metadata>
Aug 09 19:19:06 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:19:06 user nova-compute[72441]:     <system>
Aug 09 19:19:06 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:19:06 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:19:06 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:19:06 user nova-compute[72441]:       <entry name="serial">618721bf-b744-4fb7-b2b9-9972d50f15ca</entry>
Aug 09 19:19:06 user nova-compute[72441]:       <entry name="uuid">618721bf-b744-4fb7-b2b9-9972d50f15ca</entry>
Aug 09 19:19:06 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:19:06 user nova-compute[72441]:     </system>
Aug 09 19:19:06 user nova-compute[72441]:   </sysinfo>
Aug 09 19:19:06 user nova-compute[72441]:   <os>
Aug 09 19:19:06 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:19:06 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:19:06 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:19:06 user nova-compute[72441]:   </os>
Aug 09 19:19:06 user nova-compute[72441]:   <features>
Aug 09 19:19:06 user nova-compute[72441]:     <acpi/>
Aug 09 19:19:06 user nova-compute[72441]:     <apic/>
Aug 09 19:19:06 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:19:06 user nova-compute[72441]:   </features>
Aug 09 19:19:06 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:19:06 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:19:06 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:19:06 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:19:06 user nova-compute[72441]:   </clock>
Aug 09 19:19:06 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:19:06 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:19:06 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:19:06 user nova-compute[72441]:   </cpu>
Aug 09 19:19:06 user nova-compute[72441]:   <devices>
Aug 09 19:19:06 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:19:06 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:19:06 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk"/>
Aug 09 19:19:06 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:19:06 user nova-compute[72441]:     </disk>
Aug 09 19:19:06 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:06 user nova-compute[72441]:       <mac address="fa:16:3e:b4:9c:e7"/>
Aug 09 19:19:06 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:06 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:06 user nova-compute[72441]:       <target dev="tapce22d1a0-a2"/>
Aug 09 19:19:06 user nova-compute[72441]:     </interface>
Aug 09 19:19:06 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:19:06 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/console.log" append="off"/>
Aug 09 19:19:06 user nova-compute[72441]:     </serial>
Aug 09 19:19:06 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:19:06 user nova-compute[72441]:     <video>
Aug 09 19:19:06 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:06 user nova-compute[72441]:     </video>
Aug 09 19:19:06 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:19:06 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:19:06 user nova-compute[72441]:     </rng>
Aug 09 19:19:06 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:19:06 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:19:06 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:19:06 user nova-compute[72441]:     </memballoon>
Aug 09 19:19:06 user nova-compute[72441]:   </devices>
Aug 09 19:19:06 user nova-compute[72441]: </domain>
Aug 09 19:19:06 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-454392256',display_name='tempest-VolumesNegativeTest-instance-454392256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-454392256',id=11,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7ef2ebdb8d24c9fa1fd12ea4b1c3dd1',ramdisk_id='',reservation_id='r-abl7w6mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-201219142',owner_user_name='tempest-VolumesNegativeTest-201219142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data=None,user_id='f05fef9049d74ab4bb3720dda72aae89',uuid=618721bf-b744-4fb7-b2b9-9972d50f15ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Converting VIF {"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG os_vif [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9eef49aa-1883-4c2f-a1bc-832226e9c56e req-ddcd7e8a-13df-4f12-aed0-f350a356debe service nova] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce22d1a0-a2, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce22d1a0-a2, col_values=(('external_ids', {'iface-id': 'ce22d1a0-a218-4bb2-ba1c-c2a7f949e446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:9c:e7', 'vm-uuid': '618721bf-b744-4fb7-b2b9-9972d50f15ca'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:06 user nova-compute[72441]: INFO os_vif [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2')
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] No VIF found with MAC fa:16:3e:b4:9c:e7, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance network_info: |[{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Start _get_guest_xml network_info=[{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:19:00Z,direct_url=<?>,disk_format='qcow2',id=32e95858-7fe3-43aa-bce7-59edbd58d401,min_disk=0,min_ram=0,name='tempest-scenario-img--1620073708',owner='94c2820770744df88c94474a2ad02e77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:19:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '32e95858-7fe3-43aa-bce7-59edbd58d401'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:19:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:19:00Z,direct_url=<?>,disk_format='qcow2',id=32e95858-7fe3-43aa-bce7-59edbd58d401,min_disk=0,min_ram=0,name='tempest-scenario-img--1620073708',owner='94c2820770744df88c94474a2ad02e77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:19:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285238595',display_name='tempest-TestMinimumBasicScenario-server-285238595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285238595',id=12,image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJakhBNZG/Xp7L7bWk5jO8eaYkpuSgT8oEYtn5quizbZ92zPivsA/Ivc/77DanLCOTrX1xOg1fd24upHOeq48uf4kUA9e0mt+5rg1CJmzPzHqzvruTzm+V8BZa0heRH/HQ==',key_name='tempest-TestMinimumBasicScenario-633096993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-qoqrisl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:05Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=33896e33-6002-4305-9928-e958ec21155b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'pci_devices' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:19:07 user nova-compute[72441]:   <uuid>33896e33-6002-4305-9928-e958ec21155b</uuid>
Aug 09 19:19:07 user nova-compute[72441]:   <name>instance-0000000c</name>
Aug 09 19:19:07 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:19:07 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:19:07 user nova-compute[72441]:   <metadata>
Aug 09 19:19:07 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:19:07 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:19:07 user nova-compute[72441]:       <nova:name>tempest-TestMinimumBasicScenario-server-285238595</nova:name>
Aug 09 19:19:07 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:19:07</nova:creationTime>
Aug 09 19:19:07 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:19:07 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:19:07 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:19:07 user nova-compute[72441]:       <nova:owner>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:user uuid="7ba704de696a49258532080173d23fd5">tempest-TestMinimumBasicScenario-2005926422-project-member</nova:user>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:project uuid="94c2820770744df88c94474a2ad02e77">tempest-TestMinimumBasicScenario-2005926422</nova:project>
Aug 09 19:19:07 user nova-compute[72441]:       </nova:owner>
Aug 09 19:19:07 user nova-compute[72441]:       <nova:root type="image" uuid="32e95858-7fe3-43aa-bce7-59edbd58d401"/>
Aug 09 19:19:07 user nova-compute[72441]:       <nova:ports>
Aug 09 19:19:07 user nova-compute[72441]:         <nova:port uuid="01b17790-db81-4033-ac01-698aeece1f58">
Aug 09 19:19:07 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:19:07 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:07 user nova-compute[72441]:       </nova:ports>
Aug 09 19:19:07 user nova-compute[72441]:     </nova:instance>
Aug 09 19:19:07 user nova-compute[72441]:   </metadata>
Aug 09 19:19:07 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:19:07 user nova-compute[72441]:     <system>
Aug 09 19:19:07 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:19:07 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:19:07 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:19:07 user nova-compute[72441]:       <entry name="serial">33896e33-6002-4305-9928-e958ec21155b</entry>
Aug 09 19:19:07 user nova-compute[72441]:       <entry name="uuid">33896e33-6002-4305-9928-e958ec21155b</entry>
Aug 09 19:19:07 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:19:07 user nova-compute[72441]:     </system>
Aug 09 19:19:07 user nova-compute[72441]:   </sysinfo>
Aug 09 19:19:07 user nova-compute[72441]:   <os>
Aug 09 19:19:07 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:19:07 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:19:07 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:19:07 user nova-compute[72441]:   </os>
Aug 09 19:19:07 user nova-compute[72441]:   <features>
Aug 09 19:19:07 user nova-compute[72441]:     <acpi/>
Aug 09 19:19:07 user nova-compute[72441]:     <apic/>
Aug 09 19:19:07 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:19:07 user nova-compute[72441]:   </features>
Aug 09 19:19:07 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:19:07 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:19:07 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:19:07 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:19:07 user nova-compute[72441]:   </clock>
Aug 09 19:19:07 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:19:07 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:19:07 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:19:07 user nova-compute[72441]:   </cpu>
Aug 09 19:19:07 user nova-compute[72441]:   <devices>
Aug 09 19:19:07 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:19:07 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:19:07 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk"/>
Aug 09 19:19:07 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:19:07 user nova-compute[72441]:     </disk>
Aug 09 19:19:07 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:07 user nova-compute[72441]:       <mac address="fa:16:3e:ce:f2:fe"/>
Aug 09 19:19:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:07 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:07 user nova-compute[72441]:       <target dev="tap01b17790-db"/>
Aug 09 19:19:07 user nova-compute[72441]:     </interface>
Aug 09 19:19:07 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:19:07 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/console.log" append="off"/>
Aug 09 19:19:07 user nova-compute[72441]:     </serial>
Aug 09 19:19:07 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:19:07 user nova-compute[72441]:     <video>
Aug 09 19:19:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:07 user nova-compute[72441]:     </video>
Aug 09 19:19:07 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:19:07 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:19:07 user nova-compute[72441]:     </rng>
Aug 09 19:19:07 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:19:07 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:19:07 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:19:07 user nova-compute[72441]:     </memballoon>
Aug 09 19:19:07 user nova-compute[72441]:   </devices>
Aug 09 19:19:07 user nova-compute[72441]: </domain>
Aug 09 19:19:07 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285238595',display_name='tempest-TestMinimumBasicScenario-server-285238595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285238595',id=12,image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJakhBNZG/Xp7L7bWk5jO8eaYkpuSgT8oEYtn5quizbZ92zPivsA/Ivc/77DanLCOTrX1xOg1fd24upHOeq48uf4kUA9e0mt+5rg1CJmzPzHqzvruTzm+V8BZa0heRH/HQ==',key_name='tempest-TestMinimumBasicScenario-633096993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-qoqrisl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:05Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=33896e33-6002-4305-9928-e958ec21155b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG os_vif [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b17790-db, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01b17790-db, col_values=(('external_ids', {'iface-id': '01b17790-db81-4033-ac01-698aeece1f58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f2:fe', 'vm-uuid': '33896e33-6002-4305-9928-e958ec21155b'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:07 user nova-compute[72441]: INFO os_vif [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db')
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully created port: 61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No VIF found with MAC fa:16:3e:ce:f2:fe, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Updated VIF entry in instance network info cache for port ce22d1a0-a218-4bb2-ba1c-c2a7f949e446. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Updating instance_info_cache with network_info: [{"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-669e1467-4414-49b7-9d92-ed445dc3fde6 req-a5f06270-5107-4a31-b5b3-14c607dd2d00 service nova] Releasing lock "refresh_cache-618721bf-b744-4fb7-b2b9-9972d50f15ca" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-9a6f88c0-0456-41dc-a5ea-6833f28484e6. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-46a62551-3c3a-42bd-bc3c-330225f28390 req-2abc3974-4f03-46cb-b990-fd2cc341ac13 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-06878eb2-8063-4e67-948a-3f981a7dadb1 req-ab9af021-2c63-4a04-a972-ea79a050d6b0 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-06878eb2-8063-4e67-948a-3f981a7dadb1 req-ab9af021-2c63-4a04-a972-ea79a050d6b0 service nova] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-06878eb2-8063-4e67-948a-3f981a7dadb1 req-ab9af021-2c63-4a04-a972-ea79a050d6b0 service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-06878eb2-8063-4e67-948a-3f981a7dadb1 req-ab9af021-2c63-4a04-a972-ea79a050d6b0 service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-06878eb2-8063-4e67-948a-3f981a7dadb1 req-ab9af021-2c63-4a04-a972-ea79a050d6b0 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] No waiting events found dispatching network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:09 user nova-compute[72441]: WARNING nova.compute.manager [req-06878eb2-8063-4e67-948a-3f981a7dadb1 req-ab9af021-2c63-4a04-a972-ea79a050d6b0 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received unexpected event network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 for instance with vm_state building and task_state spawning.
Aug 09 19:19:09 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-497df6df-f552-42a5-bdca-69757b274ec0. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f37c6fc-0654-46a8-8399-84f7db51a232 req-ba0e81c4-83fa-4420-af0e-bd3977fdffa0 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] No waiting events found dispatching network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:11 user nova-compute[72441]: WARNING nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received unexpected event network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 for instance with vm_state building and task_state spawning.
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:11 user nova-compute[72441]: WARNING nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state building and task_state spawning.
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:11 user nova-compute[72441]: WARNING nova.compute.manager [req-7361a3bb-6a5f-4ce6-a0e1-580c91053be0 req-1229d558-b469-49d2-a63c-1f53442cd4c3 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state building and task_state spawning.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608751.9985077, 618721bf-b744-4fb7-b2b9-9972d50f15ca => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] VM Resumed (Lifecycle Event)
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Instance spawned successfully.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance spawned successfully.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608752.0047216, 33896e33-6002-4305-9928-e958ec21155b => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] VM Resumed (Lifecycle Event)
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-099ec154-1748-492d-9f87-92f7f0890c2f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Took 7.98 seconds to spawn the instance on the hypervisor.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608752.005314, 618721bf-b744-4fb7-b2b9-9972d50f15ca => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] VM Started (Lifecycle Event)
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Took 7.36 seconds to spawn the instance on the hypervisor.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608752.0053782, 33896e33-6002-4305-9928-e958ec21155b => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] VM Started (Lifecycle Event)
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Took 9.53 seconds to build instance.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:12 user nova-compute[72441]: INFO nova.compute.manager [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Took 9.28 seconds to build instance.
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7b7332d9-2fc9-43fe-86d2-caf9af1722f6 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.637s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b0cfb88-edb5-4362-b132-f74a98855105 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.373s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-0e23a2a3-e77b-408c-bf78-3bf80362e018. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Successfully updated port: 61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-96798dd0-3870-4122-bdca-c00bfe50e954 req-b39b7f9c-cc8c-4742-a361-e2415bcce210 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:19:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-61833eca-c19e-4133-aa05-ab29317b265b. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:14 user nova-compute[72441]: INFO nova.virt.block_device [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Booting with volume ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 at /dev/vdb
Aug 09 19:19:14 user nova-compute[72441]: DEBUG os_brick.utils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3453761b-5415-4ebd-b2c4-848fa59773ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4210bb6-7410-42ee-befb-1fe42a6bac5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0385ad1-7742-4079-be74-496949c4f28e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[821cbfdd-a41d-418a-a1ef-38d5fe7ae673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:15 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a42b1-5d0f-494f-b967-3f30ec4b168d]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG os_brick.utils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating existing volume attachment record: 1a3fae7a-f754-4b9c-8e22-91bb1674ed15 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:15 user nova-compute[72441]: INFO nova.compute.manager [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] instance snapshotting
Aug 09 19:19:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Beginning live snapshot process
Aug 09 19:19:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance network_info: |[{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmbbrl_hi/07fcb189090941d195e8e17895cf363d.delta 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updated VIF entry in instance network info cache for port 61833eca-c19e-4133-aa05-ab29317b265b. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmbbrl_hi/07fcb189090941d195e8e17895cf363d.delta 1073741824" returned: 0 in 0.065s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 19:19:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72441) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 19:19:16 user nova-compute[72441]: INFO nova.virt.libvirt.host [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] UEFI support detected
Aug 09 19:19:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8a4bb8ac-b385-488c-8252-a4427f3c35a5 req-5e918ab3-0e19-4b67-9aa1-732e8d072811 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:19:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:19:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 19:19:17 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:19:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmbbrl_hi/07fcb189090941d195e8e17895cf363d.delta /opt/stack/data/nova/instances/snapshots/tmpmbbrl_hi/07fcb189090941d195e8e17895cf363d {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmbbrl_hi/07fcb189090941d195e8e17895cf363d.delta /opt/stack/data/nova/instances/snapshots/tmpmbbrl_hi/07fcb189090941d195e8e17895cf363d" returned: 0 in 0.319s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Snapshot extracted, beginning image upload
Aug 09 19:19:18 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lazy-loading 'flavor' on Instance uuid ae2500e5-b241-4a6b-a778-1e39fc49969c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:19 user nova-compute[72441]: INFO nova.compute.manager [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Attaching volume 2515da49-f14a-4dba-836b-06df1c63eb55 to /dev/vdb
Aug 09 19:19:19 user nova-compute[72441]: DEBUG os_brick.utils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecdbb2d-d3cf-4fab-a7cf-5bb98a8ebc62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e26659-3f8b-42aa-bdcf-d6a9e8640925]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af4189-d94e-4961-9a28-e67003e21658]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3556bb89-f589-4ae1-a08e-3783d81ab31c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:20 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2a5b6-3be0-42dc-b3b3-3129808b839b]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG os_brick.utils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updating existing volume attachment record: 192aa9c8-239f-474c-8f60-0bcddcab4b16 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Snapshot image upload complete
Aug 09 19:19:20 user nova-compute[72441]: INFO nova.compute.manager [None req-b8b64775-35e4-4fea-89ec-430669397a1c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Took 5.24 seconds to snapshot the instance on the hypervisor.
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-changed-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Refreshing instance network info cache due to event network-changed-a225e308-07c0-4163-a087-b29c61623c4b. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] Acquiring lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] Acquired lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG nova.network.neutron [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Refreshing network info cache for port a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updated VIF entry in instance network info cache for port a225e308-07c0-4163-a087-b29c61623c4b. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updating instance_info_cache with network_info: [{"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-957a5c3b-0818-4236-92aa-91881a621971 req-0dfef102-2f2d-4e85-b213-54c1c70ac16b service nova] Releasing lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:25 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:25 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6751MB free_disk=25.499584197998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:25 user nova-compute[72441]: INFO nova.virt.block_device [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Booting with volume 12fc96b8-c8b8-46d0-b4a5-41c98de4c36b at /dev/vdc
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ae2500e5-b241-4a6b-a778-1e39fc49969c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bad8b180-4469-4439-8df9-188ec39a1314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b171d9fc-ad55-486e-a500-39070470e1f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 277c7588-02fc-4ccb-bdaa-085a6c95139d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b806d9de-624b-4ba1-99a8-cebc2b292797 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 618721bf-b744-4fb7-b2b9-9972d50f15ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33896e33-6002-4305-9928-e958ec21155b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG os_brick.utils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f783195-6747-477b-89c5-195b07933bb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[001780eb-bc25-4738-998f-738e72f0d55b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16f0806-e509-4ebb-9373-05d64435b906]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[617de496-42d5-4ecf-9466-641bed970e3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:25 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[606fb54f-730e-4a5e-849f-4703b6688fc5]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG os_brick.utils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating existing volume attachment record: 18cc3286-5227-443b-a295-a2e688e7004e {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.objects.instance [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:26 user nova-compute[72441]: INFO nova.compute.manager [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Attaching volume 983c7e86-a831-43f2-9473-2b61f56dd109 to /dev/vdb
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-changed-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Refreshing instance network info cache due to event network-changed-aae0b6a1-4106-4bbe-b283-e728f6dca34e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Refreshing network info cache for port aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG os_brick.utils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc03954-2114-4489-ae0f-e65bc9312a98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12092921-116c-4d80-b65b-70572c2b2a0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451b156-ee50-4128-85a4-cf80f49b1919]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6df91-de2f-431a-95da-9fb2b0ea674e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:26 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45af61d-dab1-4d6b-af5a-d3b3743078bf]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG os_brick.utils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updating existing volume attachment record: 76bdcad2-76c9-4882-8d51-9adb8563bd95 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updated VIF entry in instance network info cache for port aae0b6a1-4106-4bbe-b283-e728f6dca34e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-aacf71f5-380e-4397-b72e-dfa89e7a373e req-3ae63585-6e27-4b16-8b09-58ef29a8cc99 service nova] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updating instance_info_cache with network_info: [{"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-ae2500e5-b241-4a6b-a778-1e39fc49969c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connector [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Factory for ISCSI on None {{(pid=72441) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYghVWwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:29 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:29 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:29 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab8e85-45eb-4dab-bcb3-19d4913db871]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:29 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d56a1-66f1-4088-97c9-9cbea843da7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55] added
Aug 09 19:19:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a942387-f2fe-46a1-89e9-ed0117fcf8c7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.081s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d747850-d80c-478a-b939-27dd3aac5e0a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYghVWwI {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYghVWwI" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[565bb3c4-6e24-42e3-8b64-0063b0ef6111]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QYghVWwI'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ad25e-597d-44f0-bd9e-9a568fe3e2d5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee70b06-1953-4c33-be31-1d52907ae965]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:19:30 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:19:30 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:30 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:19:30 user nova-compute[72441]: 
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[83396b71-4cde-47c6-8607-4013c29cae80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260]
Aug 09 19:19:30 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2368f-baf6-4232-bcb2-a6e455623404]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de351c36-57c5-4d59-bebf-9212152260f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 (non-flash)
Aug 09 19:19:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 (non-flash)
Aug 09 19:19:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f00d58-e9a8-40b6-8deb-5c1f38cfcda1]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYghVWwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23332363031623338', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332363031623338', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lazy-loading 'flavor' on Instance uuid ae2500e5-b241-4a6b-a778-1e39fc49969c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:19:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:19:31 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:19:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:19:31 user nova-compute[72441]:   <serial>2515da49-f14a-4dba-836b-06df1c63eb55</serial>
Aug 09 19:19:31 user nova-compute[72441]: </disk>
Aug 09 19:19:31 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] No VIF found with MAC fa:16:3e:f0:b5:de, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d6b2c7fb-a2c3-441a-ad90-1e807f05f50e tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.015s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:32 user nova-compute[72441]: INFO nova.compute.manager [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Terminating instance
Aug 09 19:19:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-590cc94d-d3c7-4aed-9d23-0c4bc71aa688 req-76d652fb-dc1e-4ae3-bbe6-439d275fbaf1 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-vif-unplugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-590cc94d-d3c7-4aed-9d23-0c4bc71aa688 req-76d652fb-dc1e-4ae3-bbe6-439d275fbaf1 service nova] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-590cc94d-d3c7-4aed-9d23-0c4bc71aa688 req-76d652fb-dc1e-4ae3-bbe6-439d275fbaf1 service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-590cc94d-d3c7-4aed-9d23-0c4bc71aa688 req-76d652fb-dc1e-4ae3-bbe6-439d275fbaf1 service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-590cc94d-d3c7-4aed-9d23-0c4bc71aa688 req-76d652fb-dc1e-4ae3-bbe6-439d275fbaf1 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] No waiting events found dispatching network-vif-unplugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-590cc94d-d3c7-4aed-9d23-0c4bc71aa688 req-76d652fb-dc1e-4ae3-bbe6-439d275fbaf1 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-vif-unplugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:19:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Instance destroyed successfully.
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lazy-loading 'resources' on Instance uuid ae2500e5-b241-4a6b-a778-1e39fc49969c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1901637917',display_name='tempest-DeleteServersTestJSON-server-1901637917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1901637917',id=2,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bd1f872607409cad378294c4b02051',ramdisk_id='',reservation_id='r-h9w1bqwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1898791965',owner_user_name='tempest-DeleteServersTestJSON-1898791965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:17:39Z,user_data=None,user_id='c3edb9b7ae08449295b41cba1f18b173',uuid=ae2500e5-b241-4a6b-a778-1e39fc49969c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Converting VIF {"id": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "address": "fa:16:3e:f0:b5:de", "network": {"id": "90d76591-a515-4def-852c-730f600ee13f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1693100243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bd1f872607409cad378294c4b02051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00cd85be-5b", "ovs_interfaceid": "00cd85be-5bac-4024-85de-bf9e71aa8c62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_vif [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00cd85be-5b, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:33 user nova-compute[72441]: INFO os_vif [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:b5:de,bridge_name='br-int',has_traffic_filtering=True,id=00cd85be-5bac-4024-85de-bf9e71aa8c62,network=Network(90d76591-a515-4def-852c-730f600ee13f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00cd85be-5b')
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYghVWwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:33 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[012767d7-c295-4a1d-a68f-f3243b0d9a0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7fc26-3077-4e01-b6b6-b951aed0951c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 (non-flash)
Aug 09 19:19:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 (non-flash)
Aug 09 19:19:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9830f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0651a933-aa8f-4c25-9f97-4d450a34fc62]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b1e3f-ed22-433c-92a6-1ad712b9a700]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f1c0ac-2f7f-456b-8776-448d691b84fe]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142a72d-6588-41f3-85c8-5911c84bc195]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda12dd8-8461-4939-848a-b8f72ff9be5e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef4b69-a4f9-4439-afe7-a78400581f1d]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260]
Aug 09 19:19:33 user nova-compute[72441]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2515da49-f14a-4dba-836b-06df1c63eb55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34263b8-695f-45f0-bec8-9e4e6aedb785]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] <== disconnect_volume: return (291ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:19:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Deleting instance files /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c_del
Aug 09 19:19:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Deletion of /opt/stack/data/nova/instances/ae2500e5-b241-4a6b-a778-1e39fc49969c_del complete
Aug 09 19:19:33 user nova-compute[72441]: INFO nova.compute.manager [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 19:19:33 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:19:33 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:34 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Took 0.58 seconds to deallocate network for instance.
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-dd3c4748-82a7-466b-bf0a-c472ead1771f req-07b59c60-85db-4b9c-8aea-d62253ad6252 service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-vif-deleted-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-4788ac9a-47db-4695-bac2-2efd6410c659 req-2ef15312-30b1-42aa-9f93-c047c0c5be1b service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received event network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4788ac9a-47db-4695-bac2-2efd6410c659 req-2ef15312-30b1-42aa-9f93-c047c0c5be1b service nova] Acquiring lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4788ac9a-47db-4695-bac2-2efd6410c659 req-2ef15312-30b1-42aa-9f93-c047c0c5be1b service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4788ac9a-47db-4695-bac2-2efd6410c659 req-2ef15312-30b1-42aa-9f93-c047c0c5be1b service nova] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-4788ac9a-47db-4695-bac2-2efd6410c659 req-2ef15312-30b1-42aa-9f93-c047c0c5be1b service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] No waiting events found dispatching network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:34 user nova-compute[72441]: WARNING nova.compute.manager [req-4788ac9a-47db-4695-bac2-2efd6410c659 req-2ef15312-30b1-42aa-9f93-c047c0c5be1b service nova] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Received unexpected event network-vif-plugged-00cd85be-5bac-4024-85de-bf9e71aa8c62 for instance with vm_state active and task_state deleting.
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:19:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Creating image(s)
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Ensure instance console log exists: /opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Start _get_guest_xml network_info=[{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxgcmykj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b806d9de-624b-4ba1-99a8-cebc2b292797', 'attached_at': '', 'detached_at': '', 'volume_id': '11e433a2-c74b-42df-af90-fae220b7d38c', 'serial': '11e433a2-c74b-42df-af90-fae220b7d38c'}, 'attachment_id': '8e146c24-37c7-4701-9633-0b66fdd3e0d3', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjJxWsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b806d9de-624b-4ba1-99a8-cebc2b292797', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba843b5c-a1d4-47e4-9cf2-2a3645c3f586', 'serial': 'ba843b5c-a1d4-47e4-9cf2-2a3645c3f586'}, 'attachment_id': '1a3fae7a-f754-4b9c-8e22-91bb1674ed15', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEhKikZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b806d9de-624b-4ba1-99a8-cebc2b292797', 'attached_at': '', 'detached_at': '', 'volume_id': '12fc96b8-c8b8-46d0-b4a5-41c98de4c36b', 'serial': '12fc96b8-c8b8-46d0-b4a5-41c98de4c36b'}, 'attachment_id': '18cc3286-5227-443b-a295-a2e688e7004e', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:19:34 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:34 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:19:34 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxgcmykj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:35 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:35 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:35 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:35 user nova-compute[72441]: INFO nova.compute.manager [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Took 0.83 seconds to detach 1 volumes for instance.
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf39d9e-8169-44ea-90c1-d73a9b8b3bb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:35 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49e7afa-b5e3-49f2-96fb-911e7f28f4f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c] added
Aug 09 19:19:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04e90f-7bd7-43f3-9004-d03b46709d59]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70377e-68de-47f1-b300-a4a5f5bd2f5f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vxgcmykj {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vxgcmykj" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbecdef8-e50b-4c02-a5a8-321bf6bd58a6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vxgcmykj'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48f9a2-fdcf-4223-b8d5-713ec9907d67]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d363c31-8cba-4977-b374-c4bd528b8671]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:19:35 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:19:35 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:35 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:19:35 user nova-compute[72441]: 
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[354b1c31-37be-40b2-8a03-c577a6390961]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260]
Aug 09 19:19:35 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c12308d-0444-49e3-8aec-bf9d8871b5b6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d95237-f9da-4537-9cb6-d8c34e13942e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ea3d4-4b0f-4663-ad61-98407ff9116a]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxgcmykj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:35 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Deleted allocations for instance ae2500e5-b241-4a6b-a778-1e39fc49969c
Aug 09 19:19:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfsyeFvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:35 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-588343f9-f97e-4b70-913f-cd99f6979564 tempest-DeleteServersTestJSON-1898791965 tempest-DeleteServersTestJSON-1898791965-project-member] Lock "ae2500e5-b241-4a6b-a778-1e39fc49969c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.300s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23530353831373931', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530353831373931', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.645s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:36 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:36 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a589636-b4d1-4963-b9a1-e9e5da6a51ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:36 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjJxWsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:36 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc46bf-a965-47da-8cd8-e4c1d2974c25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109] added
Aug 09 19:19:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccfa568-9a02-4fd8-a6ba-153422b73ff8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c4ac5-406f-40d8-ab22-99a8cd04495d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfsyeFvg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfsyeFvg" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[664bf55e-58f0-4af3-ae26-fe3eb22dbd75]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfsyeFvg'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e5efb1-c573-4d70-b882-98da72e43ee6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5668fc-3bea-4e73-aec5-3048f6101870]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4acdbf4-a0ba-4656-aec6-81fb170ab00a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260]
Aug 09 19:19:36 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62bcac-95c8-4f99-97b8-822c5cb0103d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad39ab7-9413-49a1-ab06-78ad18bd1bf6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:36 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:36 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece04c8-87da-4190-89e7-123c0ae97644]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfsyeFvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== connect_volume: return (1956ms) {'type': 'block', 'scsi_wwn': '26134666537386665', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134666537386665', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.279s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:37 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:37 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46fd15b-43ca-478d-af89-585e8d7beb2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:37 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:19:37 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:19:37 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:19:37 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:19:37 user nova-compute[72441]:   <serial>983c7e86-a831-43f2-9473-2b61f56dd109</serial>
Aug 09 19:19:37 user nova-compute[72441]: </disk>
Aug 09 19:19:37 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f53bf-b5c4-472a-85f4-fcf0054648f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586] added
Aug 09 19:19:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92a982d-a9af-44e3-96e5-e3829f772604]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[94284bee-5da3-474c-8d22-79edef9d009f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjJxWsvA {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjJxWsvA" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd93a4bd-222d-4169-9fe7-3550e2090106]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tjJxWsvA'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315cb9b-2beb-4a4d-85af-891f42a0a7cd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0706beb7-1731-4ee9-920d-c31654eb0044]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:37 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:37 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b566c696-337e-4488-9f73-9c6a67204805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260]
Aug 09 19:19:37 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3b520-62a2-481b-81ff-85d2dc0edf05]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[163fe29a-6ee4-424b-864c-0903708507f8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:37 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:37 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:37 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:37 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e4c1b-ff13-40fa-914c-a61bacc84e57]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:36:9f:8e, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-46f4aa96-c2e7-490e-aa0e-4a1956995f21 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.010s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjJxWsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== connect_volume: return (2557ms) {'type': 'block', 'scsi_wwn': '23433303661666436', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303661666436', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEhKikZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:38 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:38 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:38 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc15c9d1-7150-4633-a582-d29a38cbd5bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:38 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aea0bc-4d24-492a-8d22-f15b999fa9b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b] added
Aug 09 19:19:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.115s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[963db50a-3f6e-4d97-bd19-c333ec1d16f0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecdb17-0dcd-43f8-8747-aa0d05cc3d21]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEhKikZG {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEhKikZG" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d003a1-37bc-4867-b79e-8e11733113d0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nEhKikZG'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[601cb538-f110-4087-a6c9-5cd867d0077b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[046d255c-0b27-4926-ac2d-fedb6de8a276]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bae665-866b-4df4-b73d-39b9067ef03c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260]
Aug 09 19:19:39 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[578eb425-756a-4cbc-a010-4b6c6218a7e1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c733090-49d5-4e23-a917-591ffec8bcb3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:39 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d94def9-a88f-4324-ac4a-c3b415b33a98]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEhKikZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23862623534373930', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862623534373930', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lazy-loading 'pci_devices' on Instance uuid b806d9de-624b-4ba1-99a8-cebc2b292797 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:19:40 user nova-compute[72441]:   <uuid>b806d9de-624b-4ba1-99a8-cebc2b292797</uuid>
Aug 09 19:19:40 user nova-compute[72441]:   <name>instance-0000000a</name>
Aug 09 19:19:40 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:19:40 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:19:40 user nova-compute[72441]:   <metadata>
Aug 09 19:19:40 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:19:40 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:19:40 user nova-compute[72441]:       <nova:name>tempest-device-tagging-server-240421488</nova:name>
Aug 09 19:19:40 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:19:34</nova:creationTime>
Aug 09 19:19:40 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:19:40 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:19:40 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:19:40 user nova-compute[72441]:       <nova:owner>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:user uuid="a776dda4e2fd41488650a91c885777f6">tempest-TaggedBootDevicesTest-1974786098-project-member</nova:user>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:project uuid="434cd7982c3241a6bf75a76a8c9674bc">tempest-TaggedBootDevicesTest-1974786098</nova:project>
Aug 09 19:19:40 user nova-compute[72441]:       </nova:owner>
Aug 09 19:19:40 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:19:40 user nova-compute[72441]:       <nova:ports>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="9a6f88c0-0456-41dc-a5ea-6833f28484e6">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="497df6df-f552-42a5-bdca-69757b274ec0">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="531dc6ce-ada2-438a-9b4e-09c4a4c3cb63">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="099ec154-1748-492d-9f87-92f7f0890c2f">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="0e23a2a3-e77b-408c-bf78-3bf80362e018">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="2e28c6e9-036e-4f7c-8af7-adc57d95b3c5">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:         <nova:port uuid="61833eca-c19e-4133-aa05-ab29317b265b">
Aug 09 19:19:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 19:19:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:40 user nova-compute[72441]:       </nova:ports>
Aug 09 19:19:40 user nova-compute[72441]:     </nova:instance>
Aug 09 19:19:40 user nova-compute[72441]:   </metadata>
Aug 09 19:19:40 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:19:40 user nova-compute[72441]:     <system>
Aug 09 19:19:40 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:19:40 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:19:40 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:19:40 user nova-compute[72441]:       <entry name="serial">b806d9de-624b-4ba1-99a8-cebc2b292797</entry>
Aug 09 19:19:40 user nova-compute[72441]:       <entry name="uuid">b806d9de-624b-4ba1-99a8-cebc2b292797</entry>
Aug 09 19:19:40 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:19:40 user nova-compute[72441]:     </system>
Aug 09 19:19:40 user nova-compute[72441]:   </sysinfo>
Aug 09 19:19:40 user nova-compute[72441]:   <os>
Aug 09 19:19:40 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:19:40 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:19:40 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:19:40 user nova-compute[72441]:   </os>
Aug 09 19:19:40 user nova-compute[72441]:   <features>
Aug 09 19:19:40 user nova-compute[72441]:     <acpi/>
Aug 09 19:19:40 user nova-compute[72441]:     <apic/>
Aug 09 19:19:40 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:19:40 user nova-compute[72441]:   </features>
Aug 09 19:19:40 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:19:40 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:19:40 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:19:40 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:19:40 user nova-compute[72441]:   </clock>
Aug 09 19:19:40 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:19:40 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:19:40 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:19:40 user nova-compute[72441]:   </cpu>
Aug 09 19:19:40 user nova-compute[72441]:   <devices>
Aug 09 19:19:40 user nova-compute[72441]:     <disk type="file" device="cdrom">
Aug 09 19:19:40 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 19:19:40 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797/disk.config"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="hda" bus="ide"/>
Aug 09 19:19:40 user nova-compute[72441]:     </disk>
Aug 09 19:19:40 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:19:40 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:19:40 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <serial>11e433a2-c74b-42df-af90-fae220b7d38c</serial>
Aug 09 19:19:40 user nova-compute[72441]:     </disk>
Aug 09 19:19:40 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:19:40 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:19:40 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <serial>ba843b5c-a1d4-47e4-9cf2-2a3645c3f586</serial>
Aug 09 19:19:40 user nova-compute[72441]:     </disk>
Aug 09 19:19:40 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:19:40 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:19:40 user nova-compute[72441]:       <source dev="/dev/sde"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="vdc" bus="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <serial>12fc96b8-c8b8-46d0-b4a5-41c98de4c36b</serial>
Aug 09 19:19:40 user nova-compute[72441]:     </disk>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:1e:42:24"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap9a6f88c0-04"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:23:1c:5d"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap497df6df-f5"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:cf:ba:8a"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap531dc6ce-ad"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:11:ba:e6"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap099ec154-17"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:f3:53:c7"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap0e23a2a3-e7"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:6c:dd:be"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap2e28c6e9-03"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:40 user nova-compute[72441]:       <mac address="fa:16:3e:b2:51:33"/>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:40 user nova-compute[72441]:       <target dev="tap61833eca-c1"/>
Aug 09 19:19:40 user nova-compute[72441]:     </interface>
Aug 09 19:19:40 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:19:40 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797/console.log" append="off"/>
Aug 09 19:19:40 user nova-compute[72441]:     </serial>
Aug 09 19:19:40 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:19:40 user nova-compute[72441]:     <video>
Aug 09 19:19:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:40 user nova-compute[72441]:     </video>
Aug 09 19:19:40 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:19:40 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:19:40 user nova-compute[72441]:     </rng>
Aug 09 19:19:40 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:19:40 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:19:40 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:19:40 user nova-compute[72441]:     </memballoon>
Aug 09 19:19:40 user nova-compute[72441]:   </devices>
Aug 09 19:19:40 user nova-compute[72441]: </domain>
Aug 09 19:19:40 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a6f88c0-04, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a6f88c0-04, col_values=(('external_ids', {'iface-id': '9a6f88c0-0456-41dc-a5ea-6833f28484e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:42:24', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap497df6df-f5, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap497df6df-f5, col_values=(('external_ids', {'iface-id': '497df6df-f552-42a5-bdca-69757b274ec0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:1c:5d', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap531dc6ce-ad, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap531dc6ce-ad, col_values=(('external_ids', {'iface-id': '531dc6ce-ada2-438a-9b4e-09c4a4c3cb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:ba:8a', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap099ec154-17, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap099ec154-17, col_values=(('external_ids', {'iface-id': '099ec154-1748-492d-9f87-92f7f0890c2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:ba:e6', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e23a2a3-e7, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e23a2a3-e7, col_values=(('external_ids', {'iface-id': '0e23a2a3-e77b-408c-bf78-3bf80362e018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:53:c7', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e28c6e9-03, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e28c6e9-03, col_values=(('external_ids', {'iface-id': '2e28c6e9-036e-4f7c-8af7-adc57d95b3c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:dd:be', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61833eca-c1, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61833eca-c1, col_values=(('external_ids', {'iface-id': '61833eca-c19e-4133-aa05-ab29317b265b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:51:33', 'vm-uuid': 'b806d9de-624b-4ba1-99a8-cebc2b292797'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:40 user nova-compute[72441]: INFO os_vif [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1')
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] No BDM found with device name hda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] No VIF found with MAC fa:16:3e:1e:42:24, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] No VIF found with MAC fa:16:3e:f3:53:c7, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Using config drive
Aug 09 19:19:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Creating config drive at /opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797/disk.config
Aug 09 19:19:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_symv84i {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_symv84i" returned: 0 in 0.066s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:19:42 user nova-compute[72441]: INFO nova.compute.claims [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Claim successful on node user
Aug 09 19:19:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-changed-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Refreshing instance network info cache due to event network-changed-80e491be-a99e-4cf8-bd82-79b34bcd10d3. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] Acquiring lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] Acquired lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG nova.network.neutron [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Refreshing network info cache for port 80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:19:43 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.policy [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30843aacab5b4db3b76b43cf978bc721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae6d33400f3444387a69b9fc79e4b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:19:43 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Creating image(s)
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.199s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.network.neutron [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updated VIF entry in instance network info cache for port 80e491be-a99e-4cf8-bd82-79b34bcd10d3. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.network.neutron [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updating instance_info_cache with network_info: [{"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-2d1eab47-7051-4e5e-9d4d-ff1ed7e94e85 req-d2cf33f6-7c23-4e1e-b839-8090dd31179f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2d1eab47-7051-4e5e-9d4d-ff1ed7e94e85 req-d2cf33f6-7c23-4e1e-b839-8090dd31179f service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2d1eab47-7051-4e5e-9d4d-ff1ed7e94e85 req-d2cf33f6-7c23-4e1e-b839-8090dd31179f service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2d1eab47-7051-4e5e-9d4d-ff1ed7e94e85 req-d2cf33f6-7c23-4e1e-b839-8090dd31179f service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-2d1eab47-7051-4e5e-9d4d-ff1ed7e94e85 req-d2cf33f6-7c23-4e1e-b839-8090dd31179f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:43 user nova-compute[72441]: WARNING nova.compute.manager [req-2d1eab47-7051-4e5e-9d4d-ff1ed7e94e85 req-d2cf33f6-7c23-4e1e-b839-8090dd31179f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 for instance with vm_state building and task_state spawning.
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8e9aba6d-43df-4868-abca-2bd212dad5cf req-401eeb55-6136-45f8-9e9d-573c6319dc63 service nova] Releasing lock "refresh_cache-b171d9fc-ad55-486e-a500-39070470e1f1" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk 1073741824" returned: 0 in 0.104s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.176s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Cannot resize image /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'migration_context' on Instance uuid ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Ensure instance console log exists: /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-changed-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Refreshing instance network info cache due to event network-changed-6c0b584c-4d26-4bc9-826f-e776c4f6c43d. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] Acquiring lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] Acquired lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.network.neutron [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Refreshing network info cache for port 6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Successfully created port: 1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-42f57491-786a-4052-8d52-20a819af0d73 req-fef78e66-346b-4fe4-9a7a-b85611fb8d4c service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-42f57491-786a-4052-8d52-20a819af0d73 req-fef78e66-346b-4fe4-9a7a-b85611fb8d4c service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-42f57491-786a-4052-8d52-20a819af0d73 req-fef78e66-346b-4fe4-9a7a-b85611fb8d4c service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-42f57491-786a-4052-8d52-20a819af0d73 req-fef78e66-346b-4fe4-9a7a-b85611fb8d4c service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-42f57491-786a-4052-8d52-20a819af0d73 req-fef78e66-346b-4fe4-9a7a-b85611fb8d4c service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:45 user nova-compute[72441]: WARNING nova.compute.manager [req-42f57491-786a-4052-8d52-20a819af0d73 req-fef78e66-346b-4fe4-9a7a-b85611fb8d4c service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b for instance with vm_state building and task_state spawning.
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.network.neutron [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updated VIF entry in instance network info cache for port 6c0b584c-4d26-4bc9-826f-e776c4f6c43d. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.network.neutron [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating instance_info_cache with network_info: [{"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] Releasing lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:45 user nova-compute[72441]: WARNING nova.compute.manager [req-212c27f2-f700-4c87-97c9-c19383f83ba4 req-3ddde35e-ec29-4fbc-ab67-152c5e68863f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 for instance with vm_state building and task_state spawning.
Aug 09 19:19:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:45 user nova-compute[72441]: WARNING nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 for instance with vm_state building and task_state spawning.
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:45 user nova-compute[72441]: WARNING nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 for instance with vm_state building and task_state spawning.
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:45 user nova-compute[72441]: WARNING nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 for instance with vm_state building and task_state spawning.
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:45 user nova-compute[72441]: WARNING nova.compute.manager [req-d0f375ac-7285-4519-b1ca-a01b62e80d4d req-d48048f8-f7c4-4ea2-ad91-df44799a52b5 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 for instance with vm_state building and task_state spawning.
Aug 09 19:19:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Successfully updated port: 1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquired lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:46 user nova-compute[72441]: WARNING nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 for instance with vm_state building and task_state spawning.
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:46 user nova-compute[72441]: WARNING nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f for instance with vm_state building and task_state spawning.
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:46 user nova-compute[72441]: WARNING nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f for instance with vm_state building and task_state spawning.
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:46 user nova-compute[72441]: WARNING nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 for instance with vm_state building and task_state spawning.
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-changed-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Refreshing instance network info cache due to event network-changed-1961cf02-f268-49b9-8c2a-c7895522089b. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquiring lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updating instance_info_cache with network_info: [{"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Releasing lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Instance network_info: |[{"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquired lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Refreshing network info cache for port 1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Start _get_guest_xml network_info=[{"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:19:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-52447389',display_name='tempest-AttachVolumeNegativeTest-server-52447389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-52447389',id=13,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyRlFy5rqpV1X161eP6dQ5HyMX0/Q9Zw9bEen+S5eanrF2IZSGlw26+OoTS+kT00odBx4/wZAOPHhwtlMXi/Ciymf3PotXFEfmcg8q9w+lMSSwvt8BemyFUV6oxg+1FHQ==',key_name='tempest-keypair-1270984834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-xglaee6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:46 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'pci_devices' on Instance uuid ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:19:47 user nova-compute[72441]:   <uuid>ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf</uuid>
Aug 09 19:19:47 user nova-compute[72441]:   <name>instance-0000000d</name>
Aug 09 19:19:47 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:19:47 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:19:47 user nova-compute[72441]:   <metadata>
Aug 09 19:19:47 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:19:47 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:19:47 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-52447389</nova:name>
Aug 09 19:19:47 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:19:46</nova:creationTime>
Aug 09 19:19:47 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:19:47 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:19:47 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:19:47 user nova-compute[72441]:       <nova:owner>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:user uuid="30843aacab5b4db3b76b43cf978bc721">tempest-AttachVolumeNegativeTest-2037425419-project-member</nova:user>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:project uuid="8ae6d33400f3444387a69b9fc79e4b75">tempest-AttachVolumeNegativeTest-2037425419</nova:project>
Aug 09 19:19:47 user nova-compute[72441]:       </nova:owner>
Aug 09 19:19:47 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:19:47 user nova-compute[72441]:       <nova:ports>
Aug 09 19:19:47 user nova-compute[72441]:         <nova:port uuid="1961cf02-f268-49b9-8c2a-c7895522089b">
Aug 09 19:19:47 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:19:47 user nova-compute[72441]:         </nova:port>
Aug 09 19:19:47 user nova-compute[72441]:       </nova:ports>
Aug 09 19:19:47 user nova-compute[72441]:     </nova:instance>
Aug 09 19:19:47 user nova-compute[72441]:   </metadata>
Aug 09 19:19:47 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:19:47 user nova-compute[72441]:     <system>
Aug 09 19:19:47 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:19:47 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:19:47 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:19:47 user nova-compute[72441]:       <entry name="serial">ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf</entry>
Aug 09 19:19:47 user nova-compute[72441]:       <entry name="uuid">ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf</entry>
Aug 09 19:19:47 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:19:47 user nova-compute[72441]:     </system>
Aug 09 19:19:47 user nova-compute[72441]:   </sysinfo>
Aug 09 19:19:47 user nova-compute[72441]:   <os>
Aug 09 19:19:47 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:19:47 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:19:47 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:19:47 user nova-compute[72441]:   </os>
Aug 09 19:19:47 user nova-compute[72441]:   <features>
Aug 09 19:19:47 user nova-compute[72441]:     <acpi/>
Aug 09 19:19:47 user nova-compute[72441]:     <apic/>
Aug 09 19:19:47 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:19:47 user nova-compute[72441]:   </features>
Aug 09 19:19:47 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:19:47 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:19:47 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:19:47 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:19:47 user nova-compute[72441]:   </clock>
Aug 09 19:19:47 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:19:47 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:19:47 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:19:47 user nova-compute[72441]:   </cpu>
Aug 09 19:19:47 user nova-compute[72441]:   <devices>
Aug 09 19:19:47 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:19:47 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:19:47 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk"/>
Aug 09 19:19:47 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:19:47 user nova-compute[72441]:     </disk>
Aug 09 19:19:47 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:19:47 user nova-compute[72441]:       <mac address="fa:16:3e:f9:26:4b"/>
Aug 09 19:19:47 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:47 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:19:47 user nova-compute[72441]:       <target dev="tap1961cf02-f2"/>
Aug 09 19:19:47 user nova-compute[72441]:     </interface>
Aug 09 19:19:47 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:19:47 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/console.log" append="off"/>
Aug 09 19:19:47 user nova-compute[72441]:     </serial>
Aug 09 19:19:47 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:19:47 user nova-compute[72441]:     <video>
Aug 09 19:19:47 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:19:47 user nova-compute[72441]:     </video>
Aug 09 19:19:47 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:19:47 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:19:47 user nova-compute[72441]:     </rng>
Aug 09 19:19:47 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:19:47 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:19:47 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:19:47 user nova-compute[72441]:     </memballoon>
Aug 09 19:19:47 user nova-compute[72441]:   </devices>
Aug 09 19:19:47 user nova-compute[72441]: </domain>
Aug 09 19:19:47 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-52447389',display_name='tempest-AttachVolumeNegativeTest-server-52447389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-52447389',id=13,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyRlFy5rqpV1X161eP6dQ5HyMX0/Q9Zw9bEen+S5eanrF2IZSGlw26+OoTS+kT00odBx4/wZAOPHhwtlMXi/Ciymf3PotXFEfmcg8q9w+lMSSwvt8BemyFUV6oxg+1FHQ==',key_name='tempest-keypair-1270984834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-xglaee6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG os_vif [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1961cf02-f2, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1961cf02-f2, col_values=(('external_ids', {'iface-id': '1961cf02-f268-49b9-8c2a-c7895522089b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:26:4b', 'vm-uuid': 'ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:47 user nova-compute[72441]: INFO os_vif [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2')
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:f9:26:4b, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-8afe0260-0d1b-49d3-9bd2-720bf2882b19 req-c963a68b-209f-4674-a956-4541eb31cdf6 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8afe0260-0d1b-49d3-9bd2-720bf2882b19 req-c963a68b-209f-4674-a956-4541eb31cdf6 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8afe0260-0d1b-49d3-9bd2-720bf2882b19 req-c963a68b-209f-4674-a956-4541eb31cdf6 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8afe0260-0d1b-49d3-9bd2-720bf2882b19 req-c963a68b-209f-4674-a956-4541eb31cdf6 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-8afe0260-0d1b-49d3-9bd2-720bf2882b19 req-c963a68b-209f-4674-a956-4541eb31cdf6 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:47 user nova-compute[72441]: WARNING nova.compute.manager [req-8afe0260-0d1b-49d3-9bd2-720bf2882b19 req-c963a68b-209f-4674-a956-4541eb31cdf6 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b for instance with vm_state building and task_state spawning.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608787.4021137, b806d9de-624b-4ba1-99a8-cebc2b292797 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] VM Resumed (Lifecycle Event)
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance spawned successfully.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608787.403733, b806d9de-624b-4ba1-99a8-cebc2b292797 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] VM Started (Lifecycle Event)
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Took 12.66 seconds to spawn the instance on the hypervisor.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.objects.instance [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lazy-loading 'flavor' on Instance uuid b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.network.neutron [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updated VIF entry in instance network info cache for port 1961cf02-f268-49b9-8c2a-c7895522089b. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.network.neutron [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updating instance_info_cache with network_info: [{"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Took 45.02 seconds to build instance.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Releasing lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:47 user nova-compute[72441]: WARNING nova.compute.manager [req-b7601280-1466-4dc7-80ed-a0aa36ac1f70 req-89819bcf-2e73-4685-ba5b-c44434bf10c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 for instance with vm_state building and task_state spawning.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f96095ef-ae9d-4910-9fa2-3b62481c97de tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.146s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:47 user nova-compute[72441]: INFO nova.compute.manager [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Attaching volume e085b3fa-8415-4d49-abc1-6072fe0af95f to /dev/sdc
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG os_brick.utils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'flavor' on Instance uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c603f873-7609-4173-a64f-e3f6cc0240b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-677fa749-4b89-4f82-a6bb-77b641f0d0f3 req-a13e1bb6-e570-4151-ad68-cee8cb5cc3b9 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-677fa749-4b89-4f82-a6bb-77b641f0d0f3 req-a13e1bb6-e570-4151-ad68-cee8cb5cc3b9 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-677fa749-4b89-4f82-a6bb-77b641f0d0f3 req-a13e1bb6-e570-4151-ad68-cee8cb5cc3b9 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-677fa749-4b89-4f82-a6bb-77b641f0d0f3 req-a13e1bb6-e570-4151-ad68-cee8cb5cc3b9 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-677fa749-4b89-4f82-a6bb-77b641f0d0f3 req-a13e1bb6-e570-4151-ad68-cee8cb5cc3b9 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:47 user nova-compute[72441]: WARNING nova.compute.manager [req-677fa749-4b89-4f82-a6bb-77b641f0d0f3 req-a13e1bb6-e570-4151-ad68-cee8cb5cc3b9 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 for instance with vm_state active and task_state None.
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da97ea-f51b-4661-b9bf-0b46a98c38b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e76d6-12c4-47b2-b098-fe4bee27f8d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff53de-bb52-4f0c-84a6-876e5676eb3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:48 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8f83a-1da9-4cc3-82b8-ea44c4fb7c6f]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.utils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updating existing volume attachment record: f797c54b-2172-4db9-8fb4-bebd21c0a9c7 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:48 user nova-compute[72441]: INFO nova.compute.manager [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Attaching volume e187de01-9cf8-42fa-a247-01d7eb61a6f6 to /dev/vdb
Aug 09 19:19:48 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608773.1918423, ae2500e5-b241-4a6b-a778-1e39fc49969c => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:48 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] VM Stopped (Lifecycle Event)
Aug 09 19:19:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2bedc29d-b0bd-4c0e-ab0f-ca42d878b976 None None] [instance: ae2500e5-b241-4a6b-a778-1e39fc49969c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.utils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffcf2c4-82a9-4522-b030-4351c64dd5d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1da1f5-2913-4e9d-9d34-e53e727fa606]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d3a88-e246-4922-8e13-5007038ce5f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8563a0-6dfd-47fd-ad70-253a53cc1e72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:48 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa54c8-0f71-4d52-8207-65bcd42265aa]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG os_brick.utils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating existing volume attachment record: d79a2faf-06b0-4ef6-b9c4-98d8a6aae2d6 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lazy-loading 'flavor' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:49 user nova-compute[72441]: INFO nova.compute.manager [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Attaching volume b7cb31e0-1527-47f9-be56-34d5abf7ff95 to /dev/vdb
Aug 09 19:19:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG os_brick.utils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad99e6e-b281-46b8-b5dd-6bfa86966a3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d29da8-28a6-4180-8efe-92fdf87906a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f139e2-c128-4724-91d6-7e5832576fb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d739b4-6078-4e21-a084-3c90aa917c73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:49 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872a50a-adb5-4452-a3e5-d347dca74758]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG os_brick.utils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:49 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updating existing volume attachment record: 49c47f88-3aa6-4353-896b-fffe7c35e61d {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-changed-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Refreshing instance network info cache due to event network-changed-daa475e7-76ec-4a51-aee3-a9ad52871b5e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Acquiring lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Acquired lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.network.neutron [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Refreshing network info cache for port daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.network.neutron [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updated VIF entry in instance network info cache for port daa475e7-76ec-4a51-aee3-a9ad52871b5e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.network.neutron [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updating instance_info_cache with network_info: [{"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Releasing lock "refresh_cache-277c7588-02fc-4ccb-bdaa-085a6c95139d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] No waiting events found dispatching network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:50 user nova-compute[72441]: WARNING nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received unexpected event network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b for instance with vm_state building and task_state spawning.
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] No waiting events found dispatching network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:19:50 user nova-compute[72441]: WARNING nova.compute.manager [req-435ca660-f410-4056-8ec1-feef8754b96c req-006cc92a-2860-4d7b-b1e6-25bb5b74bee3 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received unexpected event network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b for instance with vm_state building and task_state spawning.
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608791.2012353, ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] VM Resumed (Lifecycle Event)
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Instance spawned successfully.
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608791.2060647, ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] VM Started (Lifecycle Event)
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Took 7.82 seconds to spawn the instance on the hypervisor.
Aug 09 19:19:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:19:51 user nova-compute[72441]: INFO nova.compute.manager [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Took 9.04 seconds to build instance.
Aug 09 19:19:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cc3e01cd-5b36-4052-ab23-cbd528c8085c tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.166s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-changed-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Refreshing instance network info cache due to event network-changed-9b55e52a-9733-4e1c-a2f5-75082680aa4d. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] Acquiring lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] Acquired lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Refreshing network info cache for port 9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updated VIF entry in instance network info cache for port 9b55e52a-9733-4e1c-a2f5-75082680aa4d. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updating instance_info_cache with network_info: [{"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:19:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba8f9f45-1743-4349-b277-c1855098e47d req-549a6d18-6a0c-4e87-8d00-5f938dddf1ed service nova] Releasing lock "refresh_cache-ca5376e3-fc18-4583-8fbf-1ce8490ad767" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:19:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ynaWrINo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:57 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:57 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:57 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ad4b8-c4b5-463e-bcb6-030d3b5c0a6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:57 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca8621c-3ff5-4ee1-9a22-30be5d524303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f] added
Aug 09 19:19:57 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a50e7-9d99-465d-a608-aba595cfd8ee]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb73758e-9e90-4ee5-b015-a6f1f4d56dbf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ynaWrINo {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ynaWrINo" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b79a5-50c1-4864-8a95-5c3b61f65c10]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ynaWrINo'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d76ec-a297-4005-8c57-381fbed39243]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d036d5-5cff-4310-82cd-cac21ac47585]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:58 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:58 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lazy-loading 'flavor' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a9d028-53e3-459f-af5b-73e5ade5f1d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260]
Aug 09 19:19:58 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:58 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ee3ab9-12b3-4fc0-8ddf-2620e2dcd1d1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b573677-2f5f-46c2-b9bb-48686a0e1a17]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:19:58 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:58 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:19:58 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2ee4b-562a-4ca5-a42f-b1b972bc1fc3]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ynaWrINo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:19:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Attaching volume d343a198-9008-4a07-be25-56f0c5e6283a to /dev/vdb
Aug 09 19:19:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkPglVQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:58 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.utils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c698c75-05e6-4bcb-9502-749672bdc5a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[834dc031-7e77-4503-8877-cdd5a11c40ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafa17a-6a1e-4467-ba83-a04e68d7d652]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70940252-05f3-4958-8a37-6e89107aa5f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:19:58 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:19:58 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63390561-d4e0-4f59-ab04-b7b51422303b]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.utils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updating existing volume attachment record: 620c8f94-b9fa-4d3d-ad60-30ebc625a51e {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKheJmkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:19:58 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:58 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23862386265626336', 'path': '/dev/sdf'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862386265626336', 'path': '/dev/sdf'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.846s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:59 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:19:59 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lazy-loading 'flavor' on Instance uuid b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df844c8d-7131-4d77-abf5-e04e8acaf2ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:19:59 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:19:59 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:19:59 user nova-compute[72441]:   <source dev="/dev/sdf"/>
Aug 09 19:19:59 user nova-compute[72441]:   <target dev="sdc" bus="scsi"/>
Aug 09 19:19:59 user nova-compute[72441]:   <serial>e085b3fa-8415-4d49-abc1-6072fe0af95f</serial>
Aug 09 19:19:59 user nova-compute[72441]:   <address type="drive" controller="0" unit="2"/>
Aug 09 19:19:59 user nova-compute[72441]: </disk>
Aug 09 19:19:59 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b09b693-b33b-4b05-8e7a-e6d00a43deec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6] added
Aug 09 19:19:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf339b9-d0eb-402e-b448-b2f64685646c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6089e4d-08bd-4c48-815f-24ce581b15d0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkPglVQw {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkPglVQw" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb6f8e-6345-4a65-b7da-acf9ee65a55c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkPglVQw'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66700387-6e4f-46f3-917c-5432a1b174bc]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8facb74f-ef77-4dbf-bd0b-59d9287efb06]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:19:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:19:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d21f4b-a617-4ca5-b594-34ba0ddfbb28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260]
Aug 09 19:19:59 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260] successful.
Aug 09 19:19:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b3afd9-986d-4fda-bc84-ddf0cd02ace6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18466af-fa7e-4ace-830b-57d31c102a79]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:19:59 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:19:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.039s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ea25d4-9fef-4d6b-a08a-e49ac579c0a3]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkPglVQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No BDM found with device name sda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] No VIF found with MAC fa:16:3e:d9:5b:54, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:19:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-25d35b56-ea61-4e22-a620-fc934af5b658 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.074s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] <== connect_volume: return (2312ms) {'type': 'block', 'scsi_wwn': '23564626363313830', 'path': '/dev/sdg'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564626363313830', 'path': '/dev/sdg'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.766s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:00 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:00 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'flavor' on Instance uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ee829-e922-432f-9b7c-67b0199ed14e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:20:00 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5489763-5fd7-4a59-a719-2b2a8a05222b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95] added
Aug 09 19:20:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: INFO nova.compute.manager [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Detaching volume e085b3fa-8415-4d49-abc1-6072fe0af95f
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c416479-4d99-4e4b-8444-aa18b1a7e578]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:20:00 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:00 user nova-compute[72441]:   <source dev="/dev/sdg"/>
Aug 09 19:20:00 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:00 user nova-compute[72441]:   <serial>e187de01-9cf8-42fa-a247-01d7eb61a6f6</serial>
Aug 09 19:20:00 user nova-compute[72441]: </disk>
Aug 09 19:20:00 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae2432d-5e69-442f-a430-5952c74ce6d6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKheJmkb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKheJmkb" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d15b9ba-909e-4fc3-9517-5caada95a6db]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKheJmkb'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: INFO nova.virt.block_device [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Attempting to driver detach volume e085b3fa-8415-4d49-abc1-6072fe0af95f from mountpoint /dev/sdc
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e700031-3904-4f64-b46f-e8cd6a4c453e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Attempting to detach device sdc from instance b171d9fc-ad55-486e-a500-39070470e1f1 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:00 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:00 user nova-compute[72441]:   <source dev="/dev/sdf"/>
Aug 09 19:20:00 user nova-compute[72441]:   <target dev="sdc" bus="scsi"/>
Aug 09 19:20:00 user nova-compute[72441]:   <serial>e085b3fa-8415-4d49-abc1-6072fe0af95f</serial>
Aug 09 19:20:00 user nova-compute[72441]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 19:20:00 user nova-compute[72441]: </disk>
Aug 09 19:20:00 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Successfully detached device sdc from instance b171d9fc-ad55-486e-a500-39070470e1f1 from the persistent domain config.
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b171d9fc-ad55-486e-a500-39070470e1f1 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:00 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:00 user nova-compute[72441]:   <source dev="/dev/sdf"/>
Aug 09 19:20:00 user nova-compute[72441]:   <target dev="sdc" bus="scsi"/>
Aug 09 19:20:00 user nova-compute[72441]:   <serial>e085b3fa-8415-4d49-abc1-6072fe0af95f</serial>
Aug 09 19:20:00 user nova-compute[72441]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 19:20:00 user nova-compute[72441]: </disk>
Aug 09 19:20:00 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec536695-b54f-40a8-8e14-c0c35f1b8783]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:20:00 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc92749-64d9-4b36-b169-ea77eddceb21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260]
Aug 09 19:20:01 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:01 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa767816-2af3-4fd8-9e14-9447f1841168]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec7739-fe8e-4ea9-be9a-272b869216b7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:01 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e86213c-acc9-44c7-a12e-40634c749510]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKheJmkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No VIF found with MAC fa:16:3e:b5:a7:be, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d275f06b-f3f8-4dba-9467-4c20b68edc55 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.431s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691608801.6052322, b171d9fc-ad55-486e-a500-39070470e1f1 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:20:01 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Successfully detached device sdc from instance b171d9fc-ad55-486e-a500-39070470e1f1 from the live domain config.
Aug 09 19:20:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ynaWrINo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:01 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] <== connect_volume: return (3220ms) {'type': 'block', 'scsi_wwn': '23731396166323733', 'path': '/dev/sdh'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731396166323733', 'path': '/dev/sdh'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.567s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.objects.instance [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lazy-loading 'flavor' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdaecaa-0018-4456-b4cb-4a2f82ef0e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0074da0-6781-4206-b43b-498a45e4a951]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:02 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd98255a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f'): ({'sdf'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Removing single pathed devices sdf {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 19:20:02 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:02 user nova-compute[72441]:   <source dev="/dev/sdh"/>
Aug 09 19:20:02 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:02 user nova-compute[72441]:   <serial>b7cb31e0-1527-47f9-be56-34d5abf7ff95</serial>
Aug 09 19:20:02 user nova-compute[72441]: </disk>
Aug 09 19:20:02 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41c4aa6-2c63-418a-8a02-ef02cdcc1e3c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c413e-e333-4ee1-9d5c-4aea0abbdf0a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Flushing IO for device /dev/sdf {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02c4eeb-7790-4881-afed-6d0ccef631a2]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[50916104-9145-4920-a32a-84f397b3c568]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] SCSI volumes sdf have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44257cc-b51d-4571-9db8-a3f0b8ca4ee4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4210bd43-f8cc-4555-8984-2abac1e18a83]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260]
Aug 09 19:20:02 user nova-compute[72441]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:02 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e085b3fa-8415-4d49-abc1-6072fe0af95f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd80821-4949-484f-a3c0-fb031b087b53]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] <== disconnect_volume: return (919ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] No VIF found with MAC fa:16:3e:36:65:cf, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:20:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-974d0218-84a4-439e-adf3-699a80bd88d4 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.876s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:03 user nova-compute[72441]: INFO nova.compute.manager [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Detaching volume e187de01-9cf8-42fa-a247-01d7eb61a6f6
Aug 09 19:20:03 user nova-compute[72441]: INFO nova.virt.block_device [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Attempting to driver detach volume e187de01-9cf8-42fa-a247-01d7eb61a6f6 from mountpoint /dev/vdb
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Attempting to detach device vdb from instance bad8b180-4469-4439-8df9-188ec39a1314 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:03 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:03 user nova-compute[72441]:   <source dev="/dev/sdg"/>
Aug 09 19:20:03 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:03 user nova-compute[72441]:   <serial>e187de01-9cf8-42fa-a247-01d7eb61a6f6</serial>
Aug 09 19:20:03 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:20:03 user nova-compute[72441]: </disk>
Aug 09 19:20:03 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Successfully detached device vdb from instance bad8b180-4469-4439-8df9-188ec39a1314 from the persistent domain config.
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bad8b180-4469-4439-8df9-188ec39a1314 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:03 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:03 user nova-compute[72441]:   <source dev="/dev/sdg"/>
Aug 09 19:20:03 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:03 user nova-compute[72441]:   <serial>e187de01-9cf8-42fa-a247-01d7eb61a6f6</serial>
Aug 09 19:20:03 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:20:03 user nova-compute[72441]: </disk>
Aug 09 19:20:03 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] volume_snapshot_create: create_info: {'snapshot_id': 'b069c7e9-4770-4b94-906d-dace2a375760', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72441) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] snap xml: <domainsnapshot>
Aug 09 19:20:03 user nova-compute[72441]:   <disks>
Aug 09 19:20:03 user nova-compute[72441]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 09 19:20:03 user nova-compute[72441]:       <source file="/dev/new_file"/>
Aug 09 19:20:03 user nova-compute[72441]:     </disk>
Aug 09 19:20:03 user nova-compute[72441]:     <disk name="vda" snapshot="no"/>
Aug 09 19:20:03 user nova-compute[72441]:   </disks>
Aug 09 19:20:03 user nova-compute[72441]: </domainsnapshot>
Aug 09 19:20:03 user nova-compute[72441]:  {{(pid=72441) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lazy-loading 'system_metadata' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     rv = execute(f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     six.reraise(c, e, tb)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     raise value
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     rv = meth(*args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     self._volume_snapshot_create(context, instance, guest,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     rv = execute(f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     six.reraise(c, e, tb)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     raise value
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     rv = meth(*args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] 
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.objects.instance [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lazy-loading 'flavor' on Instance uuid b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-27f00ff4-4414-4654-a976-ebdfd50fadc2 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] volume_snapshot_delete: delete_info: {'volume_id': 'b7cb31e0-1527-47f9-be56-34d5abf7ff95'} {{(pid=72441) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [None req-27f00ff4-4414-4654-a976-ebdfd50fadc2 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d]     if delete_info['type'] != 'qcow2':
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] KeyError: 'type'
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] 
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81561642-cd02-4fac-a797-79333682412c tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.974s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b069c7e9-4770-4b94-906d-dace2a375760 could not be found.
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b069c7e9-4770-4b94-906d-dace2a375760 could not be found. (HTTP 404) (Request-ID: req-ddcd5fe8-01ea-4065-9310-cca4b30991e3)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b069c7e9-4770-4b94-906d-dace2a375760 could not be found.
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server [None req-7b4c3b86-9d0e-498d-9414-f20607f1fe94 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server 
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691608803.8253293, bad8b180-4469-4439-8df9-188ec39a1314 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver [None req-27f00ff4-4414-4654-a976-ebdfd50fadc2 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9f8f9711-f7d0-4915-9175-76611a03874f)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 19:20:03 user nova-compute[72441]: ERROR nova.virt.libvirt.driver 
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server [None req-27f00ff4-4414-4654-a976-ebdfd50fadc2 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 19:20:03 user nova-compute[72441]: ERROR oslo_messaging.rpc.server 
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:20:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Successfully detached device vdb from instance bad8b180-4469-4439-8df9-188ec39a1314 from the live domain config.
Aug 09 19:20:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkPglVQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:03 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff7c645-4032-4599-80eb-f3a24ad91878]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[017a1f63-004d-4004-ac6d-aa17b5a6fa03]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd906f7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6'): ({'sdg'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Removing single pathed devices sdg {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b16af7-d802-4c9f-b4b4-6ba6d6a25c4d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8cd8da-f307-42ed-9fa9-686ab737f14e]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Flushing IO for device /dev/sdg {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[77410fb2-8c08-4468-b447-6022aa83ee05]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbdf46e-93cb-42d8-8c06-d53a1e8a386e]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] SCSI volumes sdg have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2982d98a-49ad-4cb9-ba88-1d55f85edcdd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:04 user nova-compute[72441]: INFO nova.compute.manager [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Detaching volume b7cb31e0-1527-47f9-be56-34d5abf7ff95
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e455bcea-0fcd-4572-a850-8e513e20b290]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260]
Aug 09 19:20:04 user nova-compute[72441]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:04 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e187de01-9cf8-42fa-a247-01d7eb61a6f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7599e0b8-1d78-4fb2-8ffc-a8eaf1b9c1af]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] <== disconnect_volume: return (342ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:04 user nova-compute[72441]: INFO nova.virt.block_device [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Attempting to driver detach volume b7cb31e0-1527-47f9-be56-34d5abf7ff95 from mountpoint /dev/vdb
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Attempting to detach device vdb from instance 277c7588-02fc-4ccb-bdaa-085a6c95139d from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:04 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:04 user nova-compute[72441]:   <source dev="/dev/sdh"/>
Aug 09 19:20:04 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:04 user nova-compute[72441]:   <serial>b7cb31e0-1527-47f9-be56-34d5abf7ff95</serial>
Aug 09 19:20:04 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:20:04 user nova-compute[72441]: </disk>
Aug 09 19:20:04 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Successfully detached device vdb from instance 277c7588-02fc-4ccb-bdaa-085a6c95139d from the persistent domain config.
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 277c7588-02fc-4ccb-bdaa-085a6c95139d from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:04 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:04 user nova-compute[72441]:   <source dev="/dev/sdh"/>
Aug 09 19:20:04 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:04 user nova-compute[72441]:   <serial>b7cb31e0-1527-47f9-be56-34d5abf7ff95</serial>
Aug 09 19:20:04 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:20:04 user nova-compute[72441]: </disk>
Aug 09 19:20:04 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:04 user nova-compute[72441]: INFO nova.compute.manager [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Terminating instance
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691608804.7838898, 277c7588-02fc-4ccb-bdaa-085a6c95139d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:20:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Successfully detached device vdb from instance 277c7588-02fc-4ccb-bdaa-085a6c95139d from the live domain config.
Aug 09 19:20:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKheJmkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:04 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9022e-f14e-44c0-8e36-8d23a6cd5bc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e7e559-ac4c-43a9-9112-1651792c2176]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:04 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:04 user nova-compute[72441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 (non-flash)
Aug 09 19:20:04 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984d7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95'): ({'sdh'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Removing single pathed devices sdh {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-d26b3685-eaee-4cb1-b274-65fcb660623c req-f81e492e-5fee-4041-a145-fe73d6453e42 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-vif-unplugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d26b3685-eaee-4cb1-b274-65fcb660623c req-f81e492e-5fee-4041-a145-fe73d6453e42 service nova] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d26b3685-eaee-4cb1-b274-65fcb660623c req-f81e492e-5fee-4041-a145-fe73d6453e42 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d26b3685-eaee-4cb1-b274-65fcb660623c req-f81e492e-5fee-4041-a145-fe73d6453e42 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-d26b3685-eaee-4cb1-b274-65fcb660623c req-f81e492e-5fee-4041-a145-fe73d6453e42 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] No waiting events found dispatching network-vif-unplugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-d26b3685-eaee-4cb1-b274-65fcb660623c req-f81e492e-5fee-4041-a145-fe73d6453e42 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-vif-unplugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6202d7-6db8-4551-877e-cf2e46903879]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ecea22-281a-4f36-936f-f1a282fc685b]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Flushing IO for device /dev/sdh {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018046a-757e-4ea0-be27-ed0ac3e3ee1c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:04 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ab227-8f32-4838-8ceb-6d9a93f098e4]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] SCSI volumes sdh have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6c3eb-fed8-466f-974e-fac89a3e2a04]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'flavor' on Instance uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f2e84923-b7ac-4144-a489-26b0726e50f8 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[087d9577-fc76-48c0-b627-deec14af0ac9]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260]
Aug 09 19:20:05 user nova-compute[72441]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7cb31e0-1527-47f9-be56-34d5abf7ff95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c7cf3-754d-4abe-a685-419602309540]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] <== disconnect_volume: return (447ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Instance destroyed successfully.
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lazy-loading 'resources' on Instance uuid b171d9fc-ad55-486e-a500-39070470e1f1 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-316197828',display_name='tempest-AttachSCSIVolumeTestJSON-server-316197828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-316197828',id=6,image_ref='be36be2a-bd3c-4bd0-b8cb-e0bc984e55af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv2J7EvlLkd51qdl8ETMOJjqI+jqtfxltwPCS/zxYwCzBx9E91zwwcmjmcEJcMZo7VCSckEksGK0CAjByoVKE1esZPQR/JB6JN6UeGdxT7ThVDH/ac5K9S7QoFWGij7Gg==',key_name='tempest-keypair-1087709679',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d34f86c5f5ff49198815f9b4b0e28cb5',ramdisk_id='',reservation_id='r-d3okxdgy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='be36be2a-bd3c-4bd0-b8cb-e0bc984e55af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-138532495',owner_user_name='tempest-AttachSCSIVolumeTestJSON-138532495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d535fe5da6438c8c1b30117a435d86',uuid=b171d9fc-ad55-486e-a500-39070470e1f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Converting VIF {"id": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "address": "fa:16:3e:d9:5b:54", "network": {"id": "b03ee514-066c-462d-867b-c99730b5a3eb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-28534159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34f86c5f5ff49198815f9b4b0e28cb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e491be-a9", "ovs_interfaceid": "80e491be-a99e-4cf8-bd82-79b34bcd10d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG os_vif [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80e491be-a9, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:05 user nova-compute[72441]: INFO os_vif [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5b:54,bridge_name='br-int',has_traffic_filtering=True,id=80e491be-a99e-4cf8-bd82-79b34bcd10d3,network=Network(b03ee514-066c-462d-867b-c99730b5a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e491be-a9')
Aug 09 19:20:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Deleting instance files /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1_del
Aug 09 19:20:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Deletion of /opt/stack/data/nova/instances/b171d9fc-ad55-486e-a500-39070470e1f1_del complete
Aug 09 19:20:05 user nova-compute[72441]: INFO nova.compute.manager [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 09 19:20:05 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:20:05 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lazy-loading 'flavor' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4e1f5b76-65e4-4481-9a54-b55e7769cba3 tempest-VolumesAssistedSnapshotsTest-683213853 tempest-VolumesAssistedSnapshotsTest-683213853-project-admin] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:06 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Took 1.24 seconds to deallocate network for instance.
Aug 09 19:20:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] Acquiring lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] Lock "b171d9fc-ad55-486e-a500-39070470e1f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] No waiting events found dispatching network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:06 user nova-compute[72441]: WARNING nova.compute.manager [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received unexpected event network-vif-plugged-80e491be-a99e-4cf8-bd82-79b34bcd10d3 for instance with vm_state deleted and task_state None.
Aug 09 19:20:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-4267d3e8-2b67-4a15-998e-a13576bc36f7 req-97feacdd-607f-4eee-9aea-183b3e5dd073 service nova] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Received event network-vif-deleted-80e491be-a99e-4cf8-bd82-79b34bcd10d3 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:07 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:07 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:07 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Deleted allocations for instance b171d9fc-ad55-486e-a500-39070470e1f1
Aug 09 19:20:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3467cb51-c78d-4f1e-953a-01821976bb15 tempest-AttachSCSIVolumeTestJSON-138532495 tempest-AttachSCSIVolumeTestJSON-138532495-project-member] Lock "b171d9fc-ad55-486e-a500-39070470e1f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.928s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:09 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:09 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:09 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c13130-0742-4872-b21a-781807eb1e04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:20:09 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e3edf-ae73-45df-89a5-ee5dbb66e777]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a] added
Aug 09 19:20:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d455279-6ed2-4648-a5c8-84e23b88aa96]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98eb507-e4c3-4060-9688-30d3d573b9c9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUnzhEvq {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUnzhEvq" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b8d36e-9ec7-436e-a910-c8deef467e96]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dUnzhEvq'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf2dc3-4e2d-497e-94c1-c4ddaf690b5e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e48a8a1-a219-4af3-ab9c-ca40c7992e74]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7713c71d-12b8-4516-86d3-d080c2f84898]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]
Aug 09 19:20:09 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[441cf176-3268-40c2-bc28-96a7adc25a8d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1aab26-0480-448d-9153-ae66b8813290]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:09 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d28fdb-3996-4316-ab93-67351347f2bd]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26431313762323734', 'path': '/dev/sdf'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431313762323734', 'path': '/dev/sdf'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lazy-loading 'flavor' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:20:10 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:10 user nova-compute[72441]:   <source dev="/dev/sdf"/>
Aug 09 19:20:10 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:10 user nova-compute[72441]:   <serial>d343a198-9008-4a07-be25-56f0c5e6283a</serial>
Aug 09 19:20:10 user nova-compute[72441]: </disk>
Aug 09 19:20:10 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:20:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] No VIF found with MAC fa:16:3e:95:cd:a6, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:20:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6109c61e-9b6a-4261-8f7a-08efa116facd tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.888s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG os_brick.utils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972416d-a95f-4b10-9920-946800096879]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73323f-188c-4e0d-94f7-895be67c5c2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fded1c-f27a-488b-9345-c6b1da10becd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d80eb27-d7fc-4f5c-a8e4-0930416e0e5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:12 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:20:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3ba99c-9b86-4d37-bdf1-175239dca351]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:20:12 user nova-compute[72441]: DEBUG os_brick.utils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:12 user nova-compute[72441]: INFO nova.compute.manager [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Swapping volume d343a198-9008-4a07-be25-56f0c5e6283a for b1dd92ce-15f1-4d21-8f54-911221cad548
Aug 09 19:20:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:16 user nova-compute[72441]: INFO nova.compute.manager [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Terminating instance
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-762a257e-1fc1-4c57-ac7e-045f6c926439 req-234152be-2639-4f6c-aa72-7d99e252af08 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-vif-unplugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-762a257e-1fc1-4c57-ac7e-045f6c926439 req-234152be-2639-4f6c-aa72-7d99e252af08 service nova] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-762a257e-1fc1-4c57-ac7e-045f6c926439 req-234152be-2639-4f6c-aa72-7d99e252af08 service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-762a257e-1fc1-4c57-ac7e-045f6c926439 req-234152be-2639-4f6c-aa72-7d99e252af08 service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-762a257e-1fc1-4c57-ac7e-045f6c926439 req-234152be-2639-4f6c-aa72-7d99e252af08 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] No waiting events found dispatching network-vif-unplugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-762a257e-1fc1-4c57-ac7e-045f6c926439 req-234152be-2639-4f6c-aa72-7d99e252af08 service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-vif-unplugged-3bd80bef-7714-44dd-a171-7273d87c938c for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Instance destroyed successfully.
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lazy-loading 'resources' on Instance uuid 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1948542462',display_name='tempest-VolumesActionsTest-instance-1948542462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1948542462',id=9,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf07d0d151b94d1b8ebd3fe99050b6bb',ramdisk_id='',reservation_id='r-uyye35pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1935143134',owner_user_name='tempest-VolumesActionsTest-1935143134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:18:22Z,user_data=None,user_id='b7860ae33a374a1bb6b02f4523c82918',uuid=8ea4bb2e-23b4-4401-a509-8d4b5ed03247,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Converting VIF {"id": "3bd80bef-7714-44dd-a171-7273d87c938c", "address": "fa:16:3e:47:46:10", "network": {"id": "9d66490d-4aa6-4c98-b7d0-9667f3fc053b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1465526767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf07d0d151b94d1b8ebd3fe99050b6bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd80bef-77", "ovs_interfaceid": "3bd80bef-7714-44dd-a171-7273d87c938c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG os_vif [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bd80bef-77, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:16 user nova-compute[72441]: INFO os_vif [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:46:10,bridge_name='br-int',has_traffic_filtering=True,id=3bd80bef-7714-44dd-a171-7273d87c938c,network=Network(9d66490d-4aa6-4c98-b7d0-9667f3fc053b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd80bef-77')
Aug 09 19:20:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Deleting instance files /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247_del
Aug 09 19:20:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Deletion of /opt/stack/data/nova/instances/8ea4bb2e-23b4-4401-a509-8d4b5ed03247_del complete
Aug 09 19:20:16 user nova-compute[72441]: INFO nova.compute.manager [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 09 19:20:16 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:20:16 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:20:17 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:17 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Took 0.64 seconds to deallocate network for instance.
Aug 09 19:20:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:17 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:17 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:17 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Deleted allocations for instance 8ea4bb2e-23b4-4401-a509-8d4b5ed03247
Aug 09 19:20:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-285337f7-4e40-4808-b27d-468baef06826 tempest-VolumesActionsTest-1935143134 tempest-VolumesActionsTest-1935143134-project-member] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] Acquiring lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] Lock "8ea4bb2e-23b4-4401-a509-8d4b5ed03247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] No waiting events found dispatching network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:18 user nova-compute[72441]: WARNING nova.compute.manager [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received unexpected event network-vif-plugged-3bd80bef-7714-44dd-a171-7273d87c938c for instance with vm_state deleted and task_state None.
Aug 09 19:20:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-a354d11d-eb72-42e2-8a65-f2906417d29a req-f20e3b88-ba7e-4680-8466-b27b881011bd service nova] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Received event network-vif-deleted-3bd80bef-7714-44dd-a171-7273d87c938c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:20 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608805.4082954, b171d9fc-ad55-486e-a500-39070470e1f1 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:20:20 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] VM Stopped (Lifecycle Event)
Aug 09 19:20:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6d5ae17e-f600-44ca-9a9c-3c84e9d50789 None None] [instance: b171d9fc-ad55-486e-a500-39070470e1f1] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWLvGQon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1dd92ce-15f1-4d21-8f54-911221cad548', 'serial': 'b1dd92ce-15f1-4d21-8f54-911221cad548'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767', 'attached_at': '', 'detached_at': '', 'volume_id': 'd343a198-9008-4a07-be25-56f0c5e6283a', 'serial'} {{(pid=72441) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWLvGQon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:22 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:22 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:22 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8ff781-c3c3-4204-be23-56937e40c44c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:20:22 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6e629-267e-4e70-b42e-8f2a9a40be20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548] added
Aug 09 19:20:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd916c60-2191-4a4a-9de6-89c89d5700d9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70723a61-b8fe-4b3d-88e9-cba2e27de968]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWLvGQon {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWLvGQon" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cabdca-75da-417a-8d56-c5bb1103dffd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWLvGQon'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[59082cf3-8d16-48e5-80e8-aca6dec8297b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42f4ce4-7d93-44be-8bd6-1ac067a148e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5962f66-0d75-4fc6-90ca-21bee03cb5b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260]
Aug 09 19:20:22 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89178514-f4f2-46b2-9c40-e23bc5ff77ee]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a623a12-9143-476f-8554-584c25419c37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:22 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd8a9d8-edfe-4b04-a4ed-a1d7f6fd75e0]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWLvGQon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:20:23 user nova-compute[72441]: INFO nova.compute.claims [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Claim successful on node user
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23666633137616535', 'path': '/dev/sdg'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633137616535', 'path': '/dev/sdg'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lazy-loading 'flavor' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:20:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG nova.policy [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '554ea2267ce94d618fbd7ef211cb7b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d7a9e68495428292b9417ee4b234ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:20:23 user nova-compute[72441]: INFO nova.virt.block_device [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Booting with blank volume at /dev/vda
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 16777216 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 178257920 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Successfully created port: 281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:20:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 524288000 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:25 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:25 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6957MB free_disk=25.47747039794922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Successfully updated port: 281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bad8b180-4469-4439-8df9-188ec39a1314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 277c7588-02fc-4ccb-bdaa-085a6c95139d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b806d9de-624b-4ba1-99a8-cebc2b292797 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 618721bf-b744-4fb7-b2b9-9972d50f15ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33896e33-6002-4305-9928-e958ec21155b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-changed-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Refreshing instance network info cache due to event network-changed-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] Acquiring lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:20:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 691011584 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance network_info: |[{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] Acquired lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Refreshing network info cache for port 281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.811s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 868220928 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updated VIF entry in instance network info cache for port 281c4b39-0bff-4f2c-b5ef-80aadcb0a22e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fbfe50fe-fb55-4e79-a507-e433f6df30c6 req-6249c9c3-0740-4e0a-9e83-afc5a624a573 service nova] Releasing lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 1051721728 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191c729-6abd-4081-b400-d0be1808db37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e5b18f-cc5f-4e9c-bb4f-2ce95ce12468]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:27 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'): ({'sdf'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Removing single pathed devices sdf {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05647213-315c-4e37-a53a-189b37d1e29f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e8c358-70df-460b-9674-e779f222d8d1]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Flushing IO for device /dev/sdf {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52684fb-e597-442a-a0cd-1d79fd7ed63c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a02a5e-ba58-44cc-99b0-ddaf852e81e1]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] SCSI volumes sdf have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eff27a-bf83-460f-bcf0-631bd6555d77]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updating instance_info_cache with network_info: [{"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-32d57777-50e6-4fcb-b4e1-94b154e69f4d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff43225-622d-40e1-b989-fcf30e715b39]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]
Aug 09 19:20:27 user nova-compute[72441]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f96d95-b159-49c2-9d5e-ddf43ca6aed9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] <== disconnect_volume: return (301ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWLvGQon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1dd92ce-15f1-4d21-8f54-911221cad548', 'serial'} {{(pid=72441) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 19:20:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] swap_volume: removing Cinder connection for volume d343a198-9008-4a07-be25-56f0c5e6283a {{(pid=72441) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 19:20:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] swap_volume: Updating volume d343a198-9008-4a07-be25-56f0c5e6283a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "rWLvGQon", "auth_password": "o5SsXiQOhZP72Y", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "b1dd92ce-15f1-4d21-8f54-911221cad548"}, "status": "reserved", "instance": "ca5376e3-fc18-4583-8fbf-1ce8490ad767", "attached_at": "", "detached_at": "", "volume_id": "b1dd92ce-15f1-4d21-8f54-911221cad548", "serial": "b1dd92ce-15f1-4d21-8f54-911221cad548"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b1dd92ce-15f1-4d21-8f54-911221cad548', 'no_device': None, 'attachment_id': '63c89102-040a-4676-92fd-b67c11e8eae4'} {{(pid=72441) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 19:20:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-662bfd7b-ca2f-4697-90c3-02b850268b54 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.091s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd5144d-5377-478e-b918-1f8c081d27c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7224060-d50f-43d9-8091-b1816133cc4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0e3e0f-dd69-4b19-9fde-b4d858c56264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7191f7b-fd38-4490-a8ab-59ee9d900cd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:29 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:20:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579fe48-d25d-4265-911a-2a4bd69a098c]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:29 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating existing volume attachment record: 8407f5b3-01e0-4b27-bebd-ebd2e54acc6b {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG os_brick.utils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb060ff-84b5-43ed-922e-d8a8fb9d37f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2ae282-a84a-4987-aa90-33b1df307c18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d6b8aa-dd7d-460c-9c8c-2fa1d5fbc34d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9289d8-f0ab-4010-b41d-c40dfac7636c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:30 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:20:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb921098-6a06-44ce-87af-2efabf01c099]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:20:30 user nova-compute[72441]: DEBUG os_brick.utils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:30 user nova-compute[72441]: INFO nova.compute.manager [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Swapping volume b1dd92ce-15f1-4d21-8f54-911221cad548 for d343a198-9008-4a07-be25-56f0c5e6283a
Aug 09 19:20:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:31 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608816.7149887, 8ea4bb2e-23b4-4401-a509-8d4b5ed03247 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:20:31 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] VM Stopped (Lifecycle Event)
Aug 09 19:20:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d71ab2d8-470c-490a-a22a-a940fc9a0c16 None None] [instance: 8ea4bb2e-23b4-4401-a509-8d4b5ed03247] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:20:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Creating image(s)
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Ensure instance console log exists: /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Start _get_guest_xml network_info=[{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4eb07fb7-1056-44f7-a6df-c2d42c64c393', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbbff22c-817c-48f7-b3d6-0a0daf1fa632', 'serial': 'cbbff22c-817c-48f7-b3d6-0a0daf1fa632'}, 'attachment_id': '8407f5b3-01e0-4b27-bebd-ebd2e54acc6b', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:20:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:39 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:39 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:39 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[390ffb5b-012e-4a02-b3ab-c3ccb5fdb5de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:20:39 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b3b6d-6191-42f0-89dc-a23fc19c1425]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632] added
Aug 09 19:20:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ef144-564e-4db1-83e6-28ff9dabae36]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[546eb904-f1e4-4a25-8e4c-31d629b08dfd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLYXDxHG {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLYXDxHG" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc71a3e-1ffa-4611-800c-f78aec32d563]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fLYXDxHG'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767', 'attached_at': '', 'detached_at': '', 'volume_id': 'd343a198-9008-4a07-be25-56f0c5e6283a', 'serial': 'd343a198-9008-4a07-be25-56f0c5e6283a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWLvGQon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'b1dd92ce-15f1-4d21-8f54-911221cad548'}, 'status': 'reserved', 'instance': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1dd92ce-15f1-4d21-8f54-911221cad548', 'serial'} {{(pid=72441) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:39 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19b340c-2b3d-498c-87a7-3bea06b9be7c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d4905-0dd1-41f7-bc67-fda3bd712a72]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb7f8f2-9a9b-4213-a402-2ce02d7b0e3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260]
Aug 09 19:20:39 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd921456-d9e1-4fac-863a-aea8985c6891]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c9803-19eb-43f7-9a28-81e621bb3c23]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:39 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:39 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa354488-1c2e-448f-9636-7b4d83a36509]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:39 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26435323232346538', 'path': '/dev/sdf'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323232346538', 'path': '/dev/sdf'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.205s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:40 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:40 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c5a87-3272-40a9-82ab-1a54f4d91fda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:20:40 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759705474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759705474',id=14,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-hevbummp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:24Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=4eb07fb7-1056-44f7-a6df-c2d42c64c393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[44548201-4fc0-4539-912e-82c6da382795]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a] added
Aug 09 19:20:40 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:20:40 user nova-compute[72441]:   <uuid>4eb07fb7-1056-44f7-a6df-c2d42c64c393</uuid>
Aug 09 19:20:40 user nova-compute[72441]:   <name>instance-0000000e</name>
Aug 09 19:20:40 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:20:40 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:20:40 user nova-compute[72441]:   <metadata>
Aug 09 19:20:40 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:20:40 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:20:40 user nova-compute[72441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1759705474</nova:name>
Aug 09 19:20:40 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:20:39</nova:creationTime>
Aug 09 19:20:40 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:20:40 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:20:40 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:20:40 user nova-compute[72441]:       <nova:owner>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:user uuid="554ea2267ce94d618fbd7ef211cb7b51">tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member</nova:user>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:project uuid="e0d7a9e68495428292b9417ee4b234ad">tempest-ServerBootFromVolumeStableRescueTest-1993502489</nova:project>
Aug 09 19:20:40 user nova-compute[72441]:       </nova:owner>
Aug 09 19:20:40 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:20:40 user nova-compute[72441]:       <nova:ports>
Aug 09 19:20:40 user nova-compute[72441]:         <nova:port uuid="281c4b39-0bff-4f2c-b5ef-80aadcb0a22e">
Aug 09 19:20:40 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:20:40 user nova-compute[72441]:         </nova:port>
Aug 09 19:20:40 user nova-compute[72441]:       </nova:ports>
Aug 09 19:20:40 user nova-compute[72441]:     </nova:instance>
Aug 09 19:20:40 user nova-compute[72441]:   </metadata>
Aug 09 19:20:40 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:20:40 user nova-compute[72441]:     <system>
Aug 09 19:20:40 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:20:40 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:20:40 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:20:40 user nova-compute[72441]:       <entry name="serial">4eb07fb7-1056-44f7-a6df-c2d42c64c393</entry>
Aug 09 19:20:40 user nova-compute[72441]:       <entry name="uuid">4eb07fb7-1056-44f7-a6df-c2d42c64c393</entry>
Aug 09 19:20:40 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:20:40 user nova-compute[72441]:     </system>
Aug 09 19:20:40 user nova-compute[72441]:   </sysinfo>
Aug 09 19:20:40 user nova-compute[72441]:   <os>
Aug 09 19:20:40 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:20:40 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:20:40 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:20:40 user nova-compute[72441]:   </os>
Aug 09 19:20:40 user nova-compute[72441]:   <features>
Aug 09 19:20:40 user nova-compute[72441]:     <acpi/>
Aug 09 19:20:40 user nova-compute[72441]:     <apic/>
Aug 09 19:20:40 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:20:40 user nova-compute[72441]:   </features>
Aug 09 19:20:40 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:20:40 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:20:40 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:20:40 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:20:40 user nova-compute[72441]:   </clock>
Aug 09 19:20:40 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:20:40 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:20:40 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:20:40 user nova-compute[72441]:   </cpu>
Aug 09 19:20:40 user nova-compute[72441]:   <devices>
Aug 09 19:20:40 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:20:40 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:40 user nova-compute[72441]:       <source dev="/dev/sdf"/>
Aug 09 19:20:40 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:20:40 user nova-compute[72441]:       <serial>cbbff22c-817c-48f7-b3d6-0a0daf1fa632</serial>
Aug 09 19:20:40 user nova-compute[72441]:     </disk>
Aug 09 19:20:40 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:20:40 user nova-compute[72441]:       <mac address="fa:16:3e:ba:da:91"/>
Aug 09 19:20:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:20:40 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:20:40 user nova-compute[72441]:       <target dev="tap281c4b39-0b"/>
Aug 09 19:20:40 user nova-compute[72441]:     </interface>
Aug 09 19:20:40 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:20:40 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/console.log" append="off"/>
Aug 09 19:20:40 user nova-compute[72441]:     </serial>
Aug 09 19:20:40 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:20:40 user nova-compute[72441]:     <video>
Aug 09 19:20:40 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:20:40 user nova-compute[72441]:     </video>
Aug 09 19:20:40 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:20:40 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:20:40 user nova-compute[72441]:     </rng>
Aug 09 19:20:40 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:20:40 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:20:40 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:20:40 user nova-compute[72441]:     </memballoon>
Aug 09 19:20:40 user nova-compute[72441]:   </devices>
Aug 09 19:20:40 user nova-compute[72441]: </domain>
Aug 09 19:20:40 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759705474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759705474',id=14,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-hevbummp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:24Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=4eb07fb7-1056-44f7-a6df-c2d42c64c393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_vif [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap281c4b39-0b, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap281c4b39-0b, col_values=(('external_ids', {'iface-id': '281c4b39-0bff-4f2c-b5ef-80aadcb0a22e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:da:91', 'vm-uuid': '4eb07fb7-1056-44f7-a6df-c2d42c64c393'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[000b57ba-85a8-4c01-82fb-329691dc86bb]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:40 user nova-compute[72441]: INFO os_vif [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b')
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bd22ef-2b47-459f-93b1-68346f04a254]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUnzhEvq {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUnzhEvq" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22017a-101d-451e-8286-9cb9d715d83b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dUnzhEvq'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No VIF found with MAC fa:16:3e:ba:da:91, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e67d662-3ea3-4235-9858-ba7bf7396757]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d35a55-c818-4850-92fa-a59d0225c1fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --login" returned: 0 in 0.148s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f28909-2862-442b-bedb-2b2d3b6d8fa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]
Aug 09 19:20:41 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4843b6d7-0828-4625-be8e-6951c79afb20]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f2076c-da0b-4c50-aee0-3d7d31e16da8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:41 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa00692-1f19-4b38-acf9-dd35f89abbea]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] <== connect_volume: return (2683ms) {'type': 'block', 'scsi_wwn': '26431313762323734', 'path': '/dev/sdh'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431313762323734', 'path': '/dev/sdh'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lazy-loading 'flavor' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:20:42 user nova-compute[72441]: INFO nova.compute.claims [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Claim successful on node user
Aug 09 19:20:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-8891f8da-9afb-4278-bdbb-e2f3f0c7df40 req-e16addae-efc9-42f5-b1bd-06cacbf2e25b service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8891f8da-9afb-4278-bdbb-e2f3f0c7df40 req-e16addae-efc9-42f5-b1bd-06cacbf2e25b service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8891f8da-9afb-4278-bdbb-e2f3f0c7df40 req-e16addae-efc9-42f5-b1bd-06cacbf2e25b service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8891f8da-9afb-4278-bdbb-e2f3f0c7df40 req-e16addae-efc9-42f5-b1bd-06cacbf2e25b service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-8891f8da-9afb-4278-bdbb-e2f3f0c7df40 req-e16addae-efc9-42f5-b1bd-06cacbf2e25b service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:42 user nova-compute[72441]: WARNING nova.compute.manager [req-8891f8da-9afb-4278-bdbb-e2f3f0c7df40 req-e16addae-efc9-42f5-b1bd-06cacbf2e25b service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state building and task_state spawning.
Aug 09 19:20:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 167772160 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:43 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.policy [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '890855d048044ea89e304b9fc38b7600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8e21260bfe4c228b1f97b1dbb7a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:20:43 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Creating image(s)
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.198s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.192s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk 1073741824" returned: 0 in 0.059s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 514850816 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Cannot resize image /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'migration_context' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Ensure instance console log exists: /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Successfully created port: 4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-33e6bda1-a1fa-4fb1-853a-7881502e59c1 req-8f94387b-3dc7-42be-b131-4a2974b7d084 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-33e6bda1-a1fa-4fb1-853a-7881502e59c1 req-8f94387b-3dc7-42be-b131-4a2974b7d084 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-33e6bda1-a1fa-4fb1-853a-7881502e59c1 req-8f94387b-3dc7-42be-b131-4a2974b7d084 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-33e6bda1-a1fa-4fb1-853a-7881502e59c1 req-8f94387b-3dc7-42be-b131-4a2974b7d084 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-33e6bda1-a1fa-4fb1-853a-7881502e59c1 req-8f94387b-3dc7-42be-b131-4a2974b7d084 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:44 user nova-compute[72441]: WARNING nova.compute.manager [req-33e6bda1-a1fa-4fb1-853a-7881502e59c1 req-8f94387b-3dc7-42be-b131-4a2974b7d084 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state building and task_state spawning.
Aug 09 19:20:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 636485632 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 811597824 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608845.5571842, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Resumed (Lifecycle Event)
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance spawned successfully.
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.network.neutron [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Successfully updated port: 4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608845.5575411, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Started (Lifecycle Event)
Aug 09 19:20:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.network.neutron [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing instance network info cache due to event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.network.neutron [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:20:45 user nova-compute[72441]: INFO nova.compute.manager [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Took 22.77 seconds to build instance.
Aug 09 19:20:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 977272832 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f9e8afd4-40f6-451f-ac92-7ec41fdcafb5 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.914s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance network_info: |[{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Start _get_guest_xml network_info=[{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:20:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1532187531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1532187531',id=15,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyxkh/V7vIgiMnU5QRCpAzARoVccI/y1XmvHfLb2SGY89lpnKEea3r9+ah0UaGRCubwtIL5m+b9uqo633s5bE0ycaZIo0ehTjBYDEAzcUysqkf66kOCodYMVbH11gJuVg==',key_name='tempest-keypair-399743535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-yp85lf82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=9993e22d-c00a-497a-bb28-500abdc8a2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.objects.instance [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'pci_devices' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:20:46 user nova-compute[72441]:   <uuid>9993e22d-c00a-497a-bb28-500abdc8a2f3</uuid>
Aug 09 19:20:46 user nova-compute[72441]:   <name>instance-0000000f</name>
Aug 09 19:20:46 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:20:46 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:20:46 user nova-compute[72441]:   <metadata>
Aug 09 19:20:46 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:20:46 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:20:46 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1532187531</nova:name>
Aug 09 19:20:46 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:20:46</nova:creationTime>
Aug 09 19:20:46 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:20:46 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:20:46 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:20:46 user nova-compute[72441]:       <nova:owner>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:user uuid="890855d048044ea89e304b9fc38b7600">tempest-AttachVolumeShelveTestJSON-1792449968-project-member</nova:user>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:project uuid="5f8e21260bfe4c228b1f97b1dbb7a049">tempest-AttachVolumeShelveTestJSON-1792449968</nova:project>
Aug 09 19:20:46 user nova-compute[72441]:       </nova:owner>
Aug 09 19:20:46 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:20:46 user nova-compute[72441]:       <nova:ports>
Aug 09 19:20:46 user nova-compute[72441]:         <nova:port uuid="4549fab1-2c9e-42d0-8941-d981d3dee0b7">
Aug 09 19:20:46 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:20:46 user nova-compute[72441]:         </nova:port>
Aug 09 19:20:46 user nova-compute[72441]:       </nova:ports>
Aug 09 19:20:46 user nova-compute[72441]:     </nova:instance>
Aug 09 19:20:46 user nova-compute[72441]:   </metadata>
Aug 09 19:20:46 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:20:46 user nova-compute[72441]:     <system>
Aug 09 19:20:46 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:20:46 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:20:46 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:20:46 user nova-compute[72441]:       <entry name="serial">9993e22d-c00a-497a-bb28-500abdc8a2f3</entry>
Aug 09 19:20:46 user nova-compute[72441]:       <entry name="uuid">9993e22d-c00a-497a-bb28-500abdc8a2f3</entry>
Aug 09 19:20:46 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:20:46 user nova-compute[72441]:     </system>
Aug 09 19:20:46 user nova-compute[72441]:   </sysinfo>
Aug 09 19:20:46 user nova-compute[72441]:   <os>
Aug 09 19:20:46 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:20:46 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:20:46 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:20:46 user nova-compute[72441]:   </os>
Aug 09 19:20:46 user nova-compute[72441]:   <features>
Aug 09 19:20:46 user nova-compute[72441]:     <acpi/>
Aug 09 19:20:46 user nova-compute[72441]:     <apic/>
Aug 09 19:20:46 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:20:46 user nova-compute[72441]:   </features>
Aug 09 19:20:46 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:20:46 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:20:46 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:20:46 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:20:46 user nova-compute[72441]:   </clock>
Aug 09 19:20:46 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:20:46 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:20:46 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:20:46 user nova-compute[72441]:   </cpu>
Aug 09 19:20:46 user nova-compute[72441]:   <devices>
Aug 09 19:20:46 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:20:46 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:20:46 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk"/>
Aug 09 19:20:46 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:20:46 user nova-compute[72441]:     </disk>
Aug 09 19:20:46 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:20:46 user nova-compute[72441]:       <mac address="fa:16:3e:b9:ae:39"/>
Aug 09 19:20:46 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:20:46 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:20:46 user nova-compute[72441]:       <target dev="tap4549fab1-2c"/>
Aug 09 19:20:46 user nova-compute[72441]:     </interface>
Aug 09 19:20:46 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:20:46 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/console.log" append="off"/>
Aug 09 19:20:46 user nova-compute[72441]:     </serial>
Aug 09 19:20:46 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:20:46 user nova-compute[72441]:     <video>
Aug 09 19:20:46 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:20:46 user nova-compute[72441]:     </video>
Aug 09 19:20:46 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:20:46 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:20:46 user nova-compute[72441]:     </rng>
Aug 09 19:20:46 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:20:46 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:20:46 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:20:46 user nova-compute[72441]:     </memballoon>
Aug 09 19:20:46 user nova-compute[72441]:   </devices>
Aug 09 19:20:46 user nova-compute[72441]: </domain>
Aug 09 19:20:46 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1532187531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1532187531',id=15,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyxkh/V7vIgiMnU5QRCpAzARoVccI/y1XmvHfLb2SGY89lpnKEea3r9+ah0UaGRCubwtIL5m+b9uqo633s5bE0ycaZIo0ehTjBYDEAzcUysqkf66kOCodYMVbH11gJuVg==',key_name='tempest-keypair-399743535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-yp85lf82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=9993e22d-c00a-497a-bb28-500abdc8a2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_vif [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4549fab1-2c, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4549fab1-2c, col_values=(('external_ids', {'iface-id': '4549fab1-2c9e-42d0-8941-d981d3dee0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ae:39', 'vm-uuid': '9993e22d-c00a-497a-bb28-500abdc8a2f3'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:46 user nova-compute[72441]: INFO os_vif [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c')
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No VIF found with MAC fa:16:3e:b9:ae:39, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updated VIF entry in instance network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-67702d53-d842-491b-be82-1e3c3e9d8163 req-569c15f3-479c-429b-8aab-1788e8f3f4d3 service nova] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWLvGQon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'b1dd92ce-15f1-4d21-8f54-911221cad548'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:46 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb2c42-0785-48f5-aad1-ef564f9aa868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7c230-7f2a-40d3-a490-dd49fe98a4ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:46 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90592710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548'): ({'sdg'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Removing single pathed devices sdg {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68cb5cf-d361-456d-8fa3-f05fdbd95f57]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ecfa3-7cc4-4d96-a000-d1e5815bb7a4]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Flushing IO for device /dev/sdg {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[baadcd34-5d98-4224-8314-bf9845c90419]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4514d6be-7bfd-4332-bdf8-cf7b0349b0b4]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] SCSI volumes sdg have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9473c8bd-d422-4844-8cee-163f1351c0ca]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba413f6-dc7d-4bae-baed-702e3448a10e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260]
Aug 09 19:20:46 user nova-compute[72441]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd92ce-15f1-4d21-8f54-911221cad548 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a9ab2-526b-4f88-818f-484fc22da14d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] <== disconnect_volume: return (293ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'ca5376e3-fc18-4583-8fbf-1ce8490ad767', 'attached_at': '', 'detached_at': '', 'volume_id': 'd343a198-9008-4a07-be25-56f0c5e6283a', 'serial'} {{(pid=72441) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] swap_volume: removing Cinder connection for volume b1dd92ce-15f1-4d21-8f54-911221cad548 {{(pid=72441) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] swap_volume: Updating volume b1dd92ce-15f1-4d21-8f54-911221cad548 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "dUnzhEvq", "auth_password": "6Nfxs48pWZinAz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "d343a198-9008-4a07-be25-56f0c5e6283a"}, "status": "reserved", "instance": "ca5376e3-fc18-4583-8fbf-1ce8490ad767", "attached_at": "", "detached_at": "", "volume_id": "d343a198-9008-4a07-be25-56f0c5e6283a", "serial": "d343a198-9008-4a07-be25-56f0c5e6283a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd343a198-9008-4a07-be25-56f0c5e6283a', 'no_device': None, 'attachment_id': 'cc7b710c-e09c-48c4-8a86-f41ec95df84b'} {{(pid=72441) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-db3a8f47-d6b8-4652-bcf2-8caae32c93de req-0228378a-e8f3-4919-bbd2-82ee32075c67 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-db3a8f47-d6b8-4652-bcf2-8caae32c93de req-0228378a-e8f3-4919-bbd2-82ee32075c67 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-db3a8f47-d6b8-4652-bcf2-8caae32c93de req-0228378a-e8f3-4919-bbd2-82ee32075c67 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-db3a8f47-d6b8-4652-bcf2-8caae32c93de req-0228378a-e8f3-4919-bbd2-82ee32075c67 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-db3a8f47-d6b8-4652-bcf2-8caae32c93de req-0228378a-e8f3-4919-bbd2-82ee32075c67 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:47 user nova-compute[72441]: WARNING nova.compute.manager [req-db3a8f47-d6b8-4652-bcf2-8caae32c93de req-0228378a-e8f3-4919-bbd2-82ee32075c67 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state building and task_state spawning.
Aug 09 19:20:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c1891ab0-afdb-4f6b-8601-3520e4bd5574 tempest-TestVolumeSwap-768294045 tempest-TestVolumeSwap-768294045-project-admin] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.630s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Detaching volume d343a198-9008-4a07-be25-56f0c5e6283a
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.virt.block_device [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Attempting to driver detach volume d343a198-9008-4a07-be25-56f0c5e6283a from mountpoint /dev/vdb
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Attempting to detach device vdb from instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:49 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:49 user nova-compute[72441]:   <source dev="/dev/sdh"/>
Aug 09 19:20:49 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:49 user nova-compute[72441]:   <serial>d343a198-9008-4a07-be25-56f0c5e6283a</serial>
Aug 09 19:20:49 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:20:49 user nova-compute[72441]: </disk>
Aug 09 19:20:49 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Successfully detached device vdb from instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 from the persistent domain config.
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:20:49 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:20:49 user nova-compute[72441]:   <source dev="/dev/sdh"/>
Aug 09 19:20:49 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:20:49 user nova-compute[72441]:   <serial>d343a198-9008-4a07-be25-56f0c5e6283a</serial>
Aug 09 19:20:49 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:20:49 user nova-compute[72441]: </disk>
Aug 09 19:20:49 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691608849.5362258, ca5376e3-fc18-4583-8fbf-1ce8490ad767 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Successfully detached device vdb from instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 from the live domain config.
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUnzhEvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'd343a198-9008-4a07-be25-56f0c5e6283a'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed3f4ff-c407-43f1-8723-1b0dd5230df1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e54cf42-2906-44b1-a717-cfb1ac6c21d8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:49 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd98455870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a'): ({'sdh'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Removing single pathed devices sdh {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a7ffc9-0b84-40d3-a173-1588557dbd98]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d307e-36a7-48d2-9ede-a93d46ec76ad]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Flushing IO for device /dev/sdh {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c4b35-b595-4b17-ac2e-a106de0597d5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad2b17-67b7-4e89-a9ce-d0a955ce8472]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] SCSI volumes sdh have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c460ed56-1082-44a8-93f1-790321960c61]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8e8003-af15-4997-b165-3b7180dd56a3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260]
Aug 09 19:20:49 user nova-compute[72441]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d343a198-9008-4a07-be25-56f0c5e6283a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a955aeeb-afbd-4fb6-9b71-a24d796cb6ff]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] <== disconnect_volume: return (296ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608849.871607, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] VM Resumed (Lifecycle Event)
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance spawned successfully.
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608849.8731496, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] VM Started (Lifecycle Event)
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-4c75b5a2-7ec2-4eab-996d-12092d719f40 req-43001714-ccdf-4502-9e08-f6256c39f797 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4c75b5a2-7ec2-4eab-996d-12092d719f40 req-43001714-ccdf-4502-9e08-f6256c39f797 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4c75b5a2-7ec2-4eab-996d-12092d719f40 req-43001714-ccdf-4502-9e08-f6256c39f797 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4c75b5a2-7ec2-4eab-996d-12092d719f40 req-43001714-ccdf-4502-9e08-f6256c39f797 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-4c75b5a2-7ec2-4eab-996d-12092d719f40 req-43001714-ccdf-4502-9e08-f6256c39f797 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:49 user nova-compute[72441]: WARNING nova.compute.manager [req-4c75b5a2-7ec2-4eab-996d-12092d719f40 req-43001714-ccdf-4502-9e08-f6256c39f797 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state building and task_state spawning.
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:20:49 user nova-compute[72441]: INFO nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 09 19:20:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:20:50 user nova-compute[72441]: INFO nova.compute.manager [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Took 7.76 seconds to build instance.
Aug 09 19:20:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-81829846-c07c-451d-b2d0-038b1a0d2dbc tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.860s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lazy-loading 'flavor' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6df732a3-7f9a-4605-86c9-3e9c1671d891 tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:52 user nova-compute[72441]: INFO nova.compute.manager [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Terminating instance
Aug 09 19:20:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-18faaadc-9cb5-4704-ab98-8aac14ee1761 req-dcd66d40-34f8-423e-928f-0cd367abf1af service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-vif-unplugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-18faaadc-9cb5-4704-ab98-8aac14ee1761 req-dcd66d40-34f8-423e-928f-0cd367abf1af service nova] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-18faaadc-9cb5-4704-ab98-8aac14ee1761 req-dcd66d40-34f8-423e-928f-0cd367abf1af service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-18faaadc-9cb5-4704-ab98-8aac14ee1761 req-dcd66d40-34f8-423e-928f-0cd367abf1af service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-18faaadc-9cb5-4704-ab98-8aac14ee1761 req-dcd66d40-34f8-423e-928f-0cd367abf1af service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] No waiting events found dispatching network-vif-unplugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-18faaadc-9cb5-4704-ab98-8aac14ee1761 req-dcd66d40-34f8-423e-928f-0cd367abf1af service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-vif-unplugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Instance destroyed successfully.
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lazy-loading 'resources' on Instance uuid 618721bf-b744-4fb7-b2b9-9972d50f15ca {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-454392256',display_name='tempest-VolumesNegativeTest-instance-454392256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-454392256',id=11,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7ef2ebdb8d24c9fa1fd12ea4b1c3dd1',ramdisk_id='',reservation_id='r-abl7w6mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-201219142',owner_user_name='tempest-VolumesNegativeTest-201219142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:12Z,user_data=None,user_id='f05fef9049d74ab4bb3720dda72aae89',uuid=618721bf-b744-4fb7-b2b9-9972d50f15ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Converting VIF {"id": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "address": "fa:16:3e:b4:9c:e7", "network": {"id": "766e21b7-c6a7-48da-aa76-4ee1e4039a6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "51e1de9317074b15852123bcf9d95af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce22d1a0-a2", "ovs_interfaceid": "ce22d1a0-a218-4bb2-ba1c-c2a7f949e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG os_vif [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce22d1a0-a2, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:53 user nova-compute[72441]: INFO os_vif [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:9c:e7,bridge_name='br-int',has_traffic_filtering=True,id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446,network=Network(766e21b7-c6a7-48da-aa76-4ee1e4039a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce22d1a0-a2')
Aug 09 19:20:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Deleting instance files /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca_del
Aug 09 19:20:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Deletion of /opt/stack/data/nova/instances/618721bf-b744-4fb7-b2b9-9972d50f15ca_del complete
Aug 09 19:20:53 user nova-compute[72441]: INFO nova.compute.manager [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 09 19:20:53 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:20:53 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:20:54 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-4522dab8-be76-4f2a-882b-2ef87beb146e req-b57a0fa9-10d7-474b-b63b-dca46608a45c service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-vif-deleted-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:54 user nova-compute[72441]: INFO nova.compute.manager [req-4522dab8-be76-4f2a-882b-2ef87beb146e req-b57a0fa9-10d7-474b-b63b-dca46608a45c service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Neutron deleted interface ce22d1a0-a218-4bb2-ba1c-c2a7f949e446; detaching it from the instance and deleting it from the info cache
Aug 09 19:20:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-4522dab8-be76-4f2a-882b-2ef87beb146e req-b57a0fa9-10d7-474b-b63b-dca46608a45c service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:54 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Took 0.82 seconds to deallocate network for instance.
Aug 09 19:20:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-4522dab8-be76-4f2a-882b-2ef87beb146e req-b57a0fa9-10d7-474b-b63b-dca46608a45c service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Detach interface failed, port_id=ce22d1a0-a218-4bb2-ba1c-c2a7f949e446, reason: Instance 618721bf-b744-4fb7-b2b9-9972d50f15ca could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:20:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:55 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Deleted allocations for instance 618721bf-b744-4fb7-b2b9-9972d50f15ca
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:20:55 user nova-compute[72441]: INFO nova.compute.claims [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Claim successful on node user
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1cdb7ec8-6591-4fb8-9148-42a5b8258735 tempest-VolumesNegativeTest-201219142 tempest-VolumesNegativeTest-201219142-project-member] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:20:55 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:20:55 user nova-compute[72441]: DEBUG nova.policy [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8c8b477c2d348c78e4ef1175a2b2c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f126de4ac5498786e47415c7e5ada4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received event network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] Acquiring lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] Lock "618721bf-b744-4fb7-b2b9-9972d50f15ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] No waiting events found dispatching network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:56 user nova-compute[72441]: WARNING nova.compute.manager [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Received unexpected event network-vif-plugged-ce22d1a0-a218-4bb2-ba1c-c2a7f949e446 for instance with vm_state deleted and task_state None.
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-changed-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing instance network info cache due to event network-changed-9a6f88c0-0456-41dc-a5ea-6833f28484e6. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] Acquiring lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] Acquired lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Refreshing network info cache for port 9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:20:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Creating image(s)
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "/opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "/opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "/opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk 1073741824" returned: 0 in 0.056s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.299s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Successfully created port: fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Cannot resize image /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.objects.instance [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'migration_context' on Instance uuid 84bdfb26-f639-4431-821c-dcdbe7a55eb7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Ensure instance console log exists: /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:56 user nova-compute[72441]: INFO nova.compute.manager [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Terminating instance
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updated VIF entry in instance network info cache for port 9a6f88c0-0456-41dc-a5ea-6833f28484e6. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:20:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e252115d-4029-4b01-90cb-09569db3ad46 req-a1525802-fb9d-4901-bba1-78e5cd094d29 service nova] Releasing lock "refresh_cache-b806d9de-624b-4ba1-99a8-cebc2b292797" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-6dc508c3-33be-477a-8b9f-eb95825281be req-a89f3e6e-89db-423a-8e9a-59e2a4f6c9c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6dc508c3-33be-477a-8b9f-eb95825281be req-a89f3e6e-89db-423a-8e9a-59e2a4f6c9c3 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6dc508c3-33be-477a-8b9f-eb95825281be req-a89f3e6e-89db-423a-8e9a-59e2a4f6c9c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6dc508c3-33be-477a-8b9f-eb95825281be req-a89f3e6e-89db-423a-8e9a-59e2a4f6c9c3 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-6dc508c3-33be-477a-8b9f-eb95825281be req-a89f3e6e-89db-423a-8e9a-59e2a4f6c9c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-6dc508c3-33be-477a-8b9f-eb95825281be req-a89f3e6e-89db-423a-8e9a-59e2a4f6c9c3 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-5728fd10-f2fe-42fd-8c7d-623843c6cb6a req-939f8983-923d-4c3d-a059-b0b55a46b83f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5728fd10-f2fe-42fd-8c7d-623843c6cb6a req-939f8983-923d-4c3d-a059-b0b55a46b83f service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5728fd10-f2fe-42fd-8c7d-623843c6cb6a req-939f8983-923d-4c3d-a059-b0b55a46b83f service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5728fd10-f2fe-42fd-8c7d-623843c6cb6a req-939f8983-923d-4c3d-a059-b0b55a46b83f service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-5728fd10-f2fe-42fd-8c7d-623843c6cb6a req-939f8983-923d-4c3d-a059-b0b55a46b83f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-5728fd10-f2fe-42fd-8c7d-623843c6cb6a req-939f8983-923d-4c3d-a059-b0b55a46b83f service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-8082c785-424a-4143-9f58-2db8567a9526 req-1980f6c1-68f4-4120-a992-8bfa21d29d43 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8082c785-424a-4143-9f58-2db8567a9526 req-1980f6c1-68f4-4120-a992-8bfa21d29d43 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8082c785-424a-4143-9f58-2db8567a9526 req-1980f6c1-68f4-4120-a992-8bfa21d29d43 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8082c785-424a-4143-9f58-2db8567a9526 req-1980f6c1-68f4-4120-a992-8bfa21d29d43 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-8082c785-424a-4143-9f58-2db8567a9526 req-1980f6c1-68f4-4120-a992-8bfa21d29d43 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-8082c785-424a-4143-9f58-2db8567a9526 req-1980f6c1-68f4-4120-a992-8bfa21d29d43 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-61833eca-c19e-4133-aa05-ab29317b265b for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Successfully updated port: fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "refresh_cache-84bdfb26-f639-4431-821c-dcdbe7a55eb7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquired lock "refresh_cache-84bdfb26-f639-4431-821c-dcdbe7a55eb7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:20:58 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Instance destroyed successfully.
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lazy-loading 'resources' on Instance uuid b806d9de-624b-4ba1-99a8-cebc2b292797 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a6f88c0-04, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:42:24,bridge_name='br-int',has_traffic_filtering=True,id=9a6f88c0-0456-41dc-a5ea-6833f28484e6,network=Network(b65b3de2-5c73-4b73-950b-193bc9462214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6f88c0-04')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap497df6df-f5, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1c:5d,bridge_name='br-int',has_traffic_filtering=True,id=497df6df-f552-42a5-bdca-69757b274ec0,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497df6df-f5')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap531dc6ce-ad, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ba:8a,bridge_name='br-int',has_traffic_filtering=True,id=531dc6ce-ada2-438a-9b4e-09c4a4c3cb63,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap531dc6ce-ad')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap099ec154-17, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:e6,bridge_name='br-int',has_traffic_filtering=True,id=099ec154-1748-492d-9f87-92f7f0890c2f,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap099ec154-17')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e23a2a3-e7, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'flavor' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c7,bridge_name='br-int',has_traffic_filtering=True,id=0e23a2a3-e77b-408c-bf78-3bf80362e018,network=Network(91eaaaac-60f2-49b9-9095-71861ba888dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e23a2a3-e7')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "address": "fa:16:3e:6c:dd:be", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e28c6e9-03", "ovs_interfaceid": "2e28c6e9-036e-4f7c-8af7-adc57d95b3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e28c6e9-03, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:dd:be,bridge_name='br-int',has_traffic_filtering=True,id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e28c6e9-03')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-240421488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-240421488',id=10,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhRo8JjCerW4HwYkvrS0A1C1MxAGVik/q3W3uaS3AxhkHcKOclKWqF1g9fodaXbp5eDujbRIgRqcYsqlGTLvS5Zm8167TulUWBdciHVdhW5QQhan1KEO/W0/rN8vI3YWQ==',key_name='tempest-keypair-1205111867',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cd7982c3241a6bf75a76a8c9674bc',ramdisk_id='',reservation_id='r-2dte9de2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1974786098',owner_user_name='tempest-TaggedBootDevicesTest-1974786098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a776dda4e2fd41488650a91c885777f6',uuid=b806d9de-624b-4ba1-99a8-cebc2b292797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converting VIF {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61833eca-c1, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-9a6f88c0-0456-41dc-a5ea-6833f28484e6 for instance with vm_state active and task_state deleting.
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-497df6df-f552-42a5-bdca-69757b274ec0 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-497df6df-f552-42a5-bdca-69757b274ec0 for instance with vm_state active and task_state deleting.
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING nova.compute.manager [req-6a3ba014-62c8-4e3e-a0a4-3f645f1fbb94 req-63c98f1c-da29-40a2-a907-1a108d416683 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-0e23a2a3-e77b-408c-bf78-3bf80362e018 for instance with vm_state active and task_state deleting.
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:51:33,bridge_name='br-int',has_traffic_filtering=True,id=61833eca-c19e-4133-aa05-ab29317b265b,network=Network(a42b6d36-cf68-454c-8723-a2626f71bd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61833eca-c1')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxgcmykj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Updating instance_info_cache with network_info: [{"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c29e35-06ea-4968-86f1-b879c964ed0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Releasing lock "refresh_cache-84bdfb26-f639-4431-821c-dcdbe7a55eb7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Instance network_info: |[{"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Start _get_guest_xml network_info=[{"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8928b3-faf3-4126-ac07-88c464e90a21]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:20:59 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:20:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90610700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1442761864',display_name='tempest-VolumesAdminNegativeTest-server-1442761864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1442761864',id=16,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f126de4ac5498786e47415c7e5ada4',ramdisk_id='',reservation_id='r-g08o3c7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1423875380',owner_user_name='tempest-VolumesAdminNegativeTest-1423875380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:56Z,user_data=None,user_id='e8c8b477c2d348c78e4ef1175a2b2c09',uuid=84bdfb26-f639-4431-821c-dcdbe7a55eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converting VIF {"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'pci_devices' on Instance uuid 84bdfb26-f639-4431-821c-dcdbe7a55eb7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc2e79-ae22-4d5a-9785-c5d6e372d3c1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:20:59 user nova-compute[72441]:   <uuid>84bdfb26-f639-4431-821c-dcdbe7a55eb7</uuid>
Aug 09 19:20:59 user nova-compute[72441]:   <name>instance-00000010</name>
Aug 09 19:20:59 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:20:59 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:20:59 user nova-compute[72441]:   <metadata>
Aug 09 19:20:59 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:20:59 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:20:59 user nova-compute[72441]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1442761864</nova:name>
Aug 09 19:20:59 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:20:59</nova:creationTime>
Aug 09 19:20:59 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:20:59 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:20:59 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:20:59 user nova-compute[72441]:       <nova:owner>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:user uuid="e8c8b477c2d348c78e4ef1175a2b2c09">tempest-VolumesAdminNegativeTest-1423875380-project-member</nova:user>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:project uuid="f9f126de4ac5498786e47415c7e5ada4">tempest-VolumesAdminNegativeTest-1423875380</nova:project>
Aug 09 19:20:59 user nova-compute[72441]:       </nova:owner>
Aug 09 19:20:59 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:20:59 user nova-compute[72441]:       <nova:ports>
Aug 09 19:20:59 user nova-compute[72441]:         <nova:port uuid="fe657026-5782-4049-8e70-928ca87dd2e9">
Aug 09 19:20:59 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 19:20:59 user nova-compute[72441]:         </nova:port>
Aug 09 19:20:59 user nova-compute[72441]:       </nova:ports>
Aug 09 19:20:59 user nova-compute[72441]:     </nova:instance>
Aug 09 19:20:59 user nova-compute[72441]:   </metadata>
Aug 09 19:20:59 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:20:59 user nova-compute[72441]:     <system>
Aug 09 19:20:59 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:20:59 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:20:59 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:20:59 user nova-compute[72441]:       <entry name="serial">84bdfb26-f639-4431-821c-dcdbe7a55eb7</entry>
Aug 09 19:20:59 user nova-compute[72441]:       <entry name="uuid">84bdfb26-f639-4431-821c-dcdbe7a55eb7</entry>
Aug 09 19:20:59 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:20:59 user nova-compute[72441]:     </system>
Aug 09 19:20:59 user nova-compute[72441]:   </sysinfo>
Aug 09 19:20:59 user nova-compute[72441]:   <os>
Aug 09 19:20:59 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:20:59 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:20:59 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:20:59 user nova-compute[72441]:   </os>
Aug 09 19:20:59 user nova-compute[72441]:   <features>
Aug 09 19:20:59 user nova-compute[72441]:     <acpi/>
Aug 09 19:20:59 user nova-compute[72441]:     <apic/>
Aug 09 19:20:59 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:20:59 user nova-compute[72441]:   </features>
Aug 09 19:20:59 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:20:59 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:20:59 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:20:59 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:20:59 user nova-compute[72441]:   </clock>
Aug 09 19:20:59 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:20:59 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:20:59 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:20:59 user nova-compute[72441]:   </cpu>
Aug 09 19:20:59 user nova-compute[72441]:   <devices>
Aug 09 19:20:59 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:20:59 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:20:59 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk"/>
Aug 09 19:20:59 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:20:59 user nova-compute[72441]:     </disk>
Aug 09 19:20:59 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:20:59 user nova-compute[72441]:       <mac address="fa:16:3e:b5:4f:4a"/>
Aug 09 19:20:59 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:20:59 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:20:59 user nova-compute[72441]:       <target dev="tapfe657026-57"/>
Aug 09 19:20:59 user nova-compute[72441]:     </interface>
Aug 09 19:20:59 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:20:59 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/console.log" append="off"/>
Aug 09 19:20:59 user nova-compute[72441]:     </serial>
Aug 09 19:20:59 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:20:59 user nova-compute[72441]:     <video>
Aug 09 19:20:59 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:20:59 user nova-compute[72441]:     </video>
Aug 09 19:20:59 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:20:59 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:20:59 user nova-compute[72441]:     </rng>
Aug 09 19:20:59 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:20:59 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:20:59 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:20:59 user nova-compute[72441]:     </memballoon>
Aug 09 19:20:59 user nova-compute[72441]:   </devices>
Aug 09 19:20:59 user nova-compute[72441]: </domain>
Aug 09 19:20:59 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1442761864',display_name='tempest-VolumesAdminNegativeTest-server-1442761864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1442761864',id=16,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f126de4ac5498786e47415c7e5ada4',ramdisk_id='',reservation_id='r-g08o3c7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1423875380',owner_user_name='tempest-VolumesAdminNegativeTest-1423875380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:56Z,user_data=None,user_id='e8c8b477c2d348c78e4ef1175a2b2c09',uuid=84bdfb26-f639-4431-821c-dcdbe7a55eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converting VIF {"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_vif [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe657026-57, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe657026-57, col_values=(('external_ids', {'iface-id': 'fe657026-5782-4049-8e70-928ca87dd2e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:4f:4a', 'vm-uuid': '84bdfb26-f639-4431-821c-dcdbe7a55eb7'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:20:59 user nova-compute[72441]: INFO os_vif [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57')
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2339d4ac-c7c3-432d-86a2-1ed41e893811]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:20:59 user nova-compute[72441]: INFO nova.compute.manager [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Attaching volume b8517e80-5774-43ac-8262-688c8fda0d8f to /dev/vdb
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c01b97c-a746-4f72-b546-f5b58b0412cf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3353a653-40a9-42e2-b1af-73aa96a8662e]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] No VIF found with MAC fa:16:3e:b5:4f:4a, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.utils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7184229-aa71-4269-a5c9-49f5242ca745]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[025351a3-59ae-4096-b7ff-69157e76a6e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[53727c5e-a3f9-4343-bf2c-ff6a2a187042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8839b9b2-ea3c-4e3d-8663-b381322db60e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b435b907-c213-490f-b9a5-e991b7f0f0a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b030e5c-f680-4a26-b5a5-341897a565cf]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260]
Aug 09 19:20:59 user nova-compute[72441]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c, portal: 172.16.0.220,3260] successful.
Aug 09 19:20:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff6b21-2506-46df-8aaf-04bfdc386c39]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.utils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating existing volume attachment record: 854c7607-c8f5-4995-8729-9a3accc84e50 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e433a2-c74b-42df-af90-fae220b7d38c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8ef046-a34c-4858-b309-5e2481047b41]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.539s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== disconnect_volume: return (542ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEhKikZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:20:59 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:20:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba95d1-f13c-4e4a-853e-a3596fc819eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:00 user nova-compute[72441]: WARNING nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-531dc6ce-ada2-438a-9b4e-09c4a4c3cb63 for instance with vm_state active and task_state deleting.
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-changed-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Refreshing instance network info cache due to event network-changed-fe657026-5782-4049-8e70-928ca87dd2e9. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquiring lock "refresh_cache-84bdfb26-f639-4431-821c-dcdbe7a55eb7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquired lock "refresh_cache-84bdfb26-f639-4431-821c-dcdbe7a55eb7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Refreshing network info cache for port fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba9a49-ad43-498a-af0d-fb81932c0d35]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:21:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b (non-flash)
Aug 09 19:21:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f95a254-6d22-4698-b57d-e83da75b6428]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd879d3a-abea-4b00-a461-2f5a78fb2343]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75319a3-c260-4cb1-9985-4c04cb5bb464]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[348ef3cf-2033-4b3c-a9b0-877e0e8a8f69]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d4a319-0897-495c-9539-56bd5b3e2dfb]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b9d92-b031-4330-b0ed-309b138f7ebc]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260]
Aug 09 19:21:00 user nova-compute[72441]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fc96b8-c8b8-46d0-b4a5-41c98de4c36b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[da49ff12-aa3c-4825-994e-deedf5bf868e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== disconnect_volume: return (314ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjJxWsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:00 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-1f1ebf00-56a2-48e4-b9e6-b8b50b8e6203 req-dbaaa0eb-f627-457d-8c24-f158118e2bef service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1f1ebf00-56a2-48e4-b9e6-b8b50b8e6203 req-dbaaa0eb-f627-457d-8c24-f158118e2bef service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1f1ebf00-56a2-48e4-b9e6-b8b50b8e6203 req-dbaaa0eb-f627-457d-8c24-f158118e2bef service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1f1ebf00-56a2-48e4-b9e6-b8b50b8e6203 req-dbaaa0eb-f627-457d-8c24-f158118e2bef service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-1f1ebf00-56a2-48e4-b9e6-b8b50b8e6203 req-dbaaa0eb-f627-457d-8c24-f158118e2bef service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:00 user nova-compute[72441]: WARNING nova.compute.manager [req-1f1ebf00-56a2-48e4-b9e6-b8b50b8e6203 req-dbaaa0eb-f627-457d-8c24-f158118e2bef service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-61833eca-c19e-4133-aa05-ab29317b265b for instance with vm_state active and task_state deleting.
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd9b68-4956-461c-9de1-07f49ae1e20f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[90699ef4-db77-48f4-977f-5f6047e627ae]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 (non-flash)
Aug 09 19:21:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90574940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0a857-b3ee-4996-bc8b-c6729b4fd8bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a24957-4177-425e-9cc4-e587483a2b95]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7488ed-65f8-4eca-b043-85c53967760f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c64cf0-762e-468e-85ce-44db8675259e]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd56d8-3411-4362-a0ba-f344a8a3720d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8c58fa-a711-47aa-b98f-ffb720bc73ac]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260]
Aug 09 19:21:00 user nova-compute[72441]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba843b5c-a1d4-47e4-9cf2-2a3645c3f586 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2911081-5d1a-41a6-8569-73dd1048957f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] <== disconnect_volume: return (272ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:21:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Deleting instance files /opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797_del
Aug 09 19:21:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Deletion of /opt/stack/data/nova/instances/b806d9de-624b-4ba1-99a8-cebc2b292797_del complete
Aug 09 19:21:00 user nova-compute[72441]: INFO nova.compute.manager [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Took 3.69 seconds to destroy the instance on the hypervisor.
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Updated VIF entry in instance network info cache for port fe657026-5782-4049-8e70-928ca87dd2e9. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Updating instance_info_cache with network_info: [{"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Releasing lock "refresh_cache-84bdfb26-f639-4431-821c-dcdbe7a55eb7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-099ec154-1748-492d-9f87-92f7f0890c2f for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:00 user nova-compute[72441]: WARNING nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-099ec154-1748-492d-9f87-92f7f0890c2f for instance with vm_state active and task_state deleting.
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-unplugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-unplugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Acquiring lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] No waiting events found dispatching network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:00 user nova-compute[72441]: WARNING nova.compute.manager [req-fe42176a-c1b0-4a12-b83c-fc547d4d2733 req-80ad352c-74ee-4bd5-b897-97063cee1171 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received unexpected event network-vif-plugged-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 for instance with vm_state active and task_state deleting.
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:01 user nova-compute[72441]: INFO nova.compute.manager [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Terminating instance
Aug 09 19:21:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:02 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Instance destroyed successfully.
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lazy-loading 'resources' on Instance uuid 277c7588-02fc-4ccb-bdaa-085a6c95139d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-463277449',display_name='tempest-VolumesAssistedSnapshotsTest-server-463277449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-463277449',id=7,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcMCMzI7xfmHOCT+PIzh21RWkNmzWcM88f9iKUa/09Ibre9vE99jgZd7ytcMo8yqa5STa+5EWL0DfSeZyYy17jrkz3zJPoun864MgKgAw4bRFdkuGY7DaaW4Y6mgzBAQQ==',key_name='tempest-keypair-84153918',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72e6e46a72e5405b8ac520a50439748f',ramdisk_id='',reservation_id='r-sy5rux3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-513075373',owner_user_name='tempest-VolumesAssistedSnapshotsTest-513075373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f5c0e5f88ea40a3949d8ee0fc7f1f32',uuid=277c7588-02fc-4ccb-bdaa-085a6c95139d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Converting VIF {"id": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "address": "fa:16:3e:36:65:cf", "network": {"id": "2b406230-32a2-4d91-8817-91f96bf50313", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-89308428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72e6e46a72e5405b8ac520a50439748f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa475e7-76", "ovs_interfaceid": "daa475e7-76ec-4a51-aee3-a9ad52871b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG os_vif [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaa475e7-76, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:02 user nova-compute[72441]: INFO os_vif [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:65:cf,bridge_name='br-int',has_traffic_filtering=True,id=daa475e7-76ec-4a51-aee3-a9ad52871b5e,network=Network(2b406230-32a2-4d91-8817-91f96bf50313),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa475e7-76')
Aug 09 19:21:02 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Deleting instance files /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d_del
Aug 09 19:21:02 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Deletion of /opt/stack/data/nova/instances/277c7588-02fc-4ccb-bdaa-085a6c95139d_del complete
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60cccb8f-750e-4091-8c41-c063f5606fc0 req-fec43647-27e1-47fc-9fca-6ee8b2ef4a32 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-vif-unplugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60cccb8f-750e-4091-8c41-c063f5606fc0 req-fec43647-27e1-47fc-9fca-6ee8b2ef4a32 service nova] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60cccb8f-750e-4091-8c41-c063f5606fc0 req-fec43647-27e1-47fc-9fca-6ee8b2ef4a32 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60cccb8f-750e-4091-8c41-c063f5606fc0 req-fec43647-27e1-47fc-9fca-6ee8b2ef4a32 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60cccb8f-750e-4091-8c41-c063f5606fc0 req-fec43647-27e1-47fc-9fca-6ee8b2ef4a32 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] No waiting events found dispatching network-vif-unplugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60cccb8f-750e-4091-8c41-c063f5606fc0 req-fec43647-27e1-47fc-9fca-6ee8b2ef4a32 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-vif-unplugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:21:02 user nova-compute[72441]: INFO nova.compute.manager [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] No waiting events found dispatching network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:02 user nova-compute[72441]: WARNING nova.compute.manager [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received unexpected event network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 for instance with vm_state building and task_state spawning.
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] No waiting events found dispatching network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:02 user nova-compute[72441]: WARNING nova.compute.manager [req-a2faa79e-7703-4320-8402-3b1e8143129b req-304addbf-40d0-4e20-82fc-a17d353a498e service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received unexpected event network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 for instance with vm_state building and task_state spawning.
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-956beb58-265e-4a5a-8377-ba11eb17726b req-1d368b65-8873-4214-8d48-d41501429823 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-vif-deleted-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [req-956beb58-265e-4a5a-8377-ba11eb17726b req-1d368b65-8873-4214-8d48-d41501429823 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Neutron deleted interface daa475e7-76ec-4a51-aee3-a9ad52871b5e; detaching it from the instance and deleting it from the info cache
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.network.neutron [req-956beb58-265e-4a5a-8377-ba11eb17726b req-1d368b65-8873-4214-8d48-d41501429823 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Took 0.93 seconds to deallocate network for instance.
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-956beb58-265e-4a5a-8377-ba11eb17726b req-1d368b65-8873-4214-8d48-d41501429823 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Detach interface failed, port_id=daa475e7-76ec-4a51-aee3-a9ad52871b5e, reason: Instance 277c7588-02fc-4ccb-bdaa-085a6c95139d could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608863.5801163, 84bdfb26-f639-4431-821c-dcdbe7a55eb7 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] VM Resumed (Lifecycle Event)
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Instance spawned successfully.
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608863.5853574, 84bdfb26-f639-4431-821c-dcdbe7a55eb7 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] VM Started (Lifecycle Event)
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Took 7.69 seconds to spawn the instance on the hypervisor.
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.compute.manager [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Took 8.71 seconds to build instance.
Aug 09 19:21:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-12e49623-0b64-48f8-9e8a-97565e934cf7 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.854s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:03 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Deleted allocations for instance 277c7588-02fc-4ccb-bdaa-085a6c95139d
Aug 09 19:21:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9f6e8558-260b-43ca-b8ec-2404c33c9bf1 tempest-VolumesAssistedSnapshotsTest-513075373 tempest-VolumesAssistedSnapshotsTest-513075373-project-member] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received event network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] Acquiring lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] Lock "277c7588-02fc-4ccb-bdaa-085a6c95139d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] No waiting events found dispatching network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:04 user nova-compute[72441]: WARNING nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Received unexpected event network-vif-plugged-daa475e7-76ec-4a51-aee3-a9ad52871b5e for instance with vm_state deleted and task_state None.
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-deleted-2e28c6e9-036e-4f7c-8af7-adc57d95b3c5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:04 user nova-compute[72441]: INFO nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Neutron deleted interface 2e28c6e9-036e-4f7c-8af7-adc57d95b3c5; detaching it from the instance and deleting it from the info cache
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.network.neutron [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "address": "fa:16:3e:f3:53:c7", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e23a2a3-e7", "ovs_interfaceid": "0e23a2a3-e77b-408c-bf78-3bf80362e018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Detach interface failed, port_id=2e28c6e9-036e-4f7c-8af7-adc57d95b3c5, reason: Instance b806d9de-624b-4ba1-99a8-cebc2b292797 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-deleted-0e23a2a3-e77b-408c-bf78-3bf80362e018 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:04 user nova-compute[72441]: INFO nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Neutron deleted interface 0e23a2a3-e77b-408c-bf78-3bf80362e018; detaching it from the instance and deleting it from the info cache
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.network.neutron [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61833eca-c19e-4133-aa05-ab29317b265b", "address": "fa:16:3e:b2:51:33", "network": {"id": "a42b6d36-cf68-454c-8723-a2626f71bd62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1316541140", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61833eca-c1", "ovs_interfaceid": "61833eca-c19e-4133-aa05-ab29317b265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Detach interface failed, port_id=0e23a2a3-e77b-408c-bf78-3bf80362e018, reason: Instance b806d9de-624b-4ba1-99a8-cebc2b292797 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-deleted-61833eca-c19e-4133-aa05-ab29317b265b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:04 user nova-compute[72441]: INFO nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Neutron deleted interface 61833eca-c19e-4133-aa05-ab29317b265b; detaching it from the instance and deleting it from the info cache
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.network.neutron [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [{"id": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "address": "fa:16:3e:1e:42:24", "network": {"id": "b65b3de2-5c73-4b73-950b-193bc9462214", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2009066042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6f88c0-04", "ovs_interfaceid": "9a6f88c0-0456-41dc-a5ea-6833f28484e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497df6df-f552-42a5-bdca-69757b274ec0", "address": "fa:16:3e:23:1c:5d", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497df6df-f5", "ovs_interfaceid": "497df6df-f552-42a5-bdca-69757b274ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "address": "fa:16:3e:cf:ba:8a", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531dc6ce-ad", "ovs_interfaceid": "531dc6ce-ada2-438a-9b4e-09c4a4c3cb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "099ec154-1748-492d-9f87-92f7f0890c2f", "address": "fa:16:3e:11:ba:e6", "network": {"id": "91eaaaac-60f2-49b9-9095-71861ba888dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1852848098", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "434cd7982c3241a6bf75a76a8c9674bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap099ec154-17", "ovs_interfaceid": "099ec154-1748-492d-9f87-92f7f0890c2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-58178597-1add-45d9-9f17-9a6183717d07 req-a7b602f3-3c27-4ad0-aa32-a38197b116a2 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Detach interface failed, port_id=61833eca-c19e-4133-aa05-ab29317b265b, reason: Instance b806d9de-624b-4ba1-99a8-cebc2b292797 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:21:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:05 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:05 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Took 4.68 seconds to deallocate network for instance.
Aug 09 19:21:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-1b1271b7-3935-4ca7-9ff3-9ce6b881347c req-60ecaeb5-4bd0-43a7-bb40-d7b7bf938c46 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-deleted-099ec154-1748-492d-9f87-92f7f0890c2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-1b1271b7-3935-4ca7-9ff3-9ce6b881347c req-60ecaeb5-4bd0-43a7-bb40-d7b7bf938c46 service nova] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Received event network-vif-deleted-9a6f88c0-0456-41dc-a5ea-6833f28484e6 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:07 user nova-compute[72441]: INFO nova.compute.manager [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Took 2.58 seconds to detach 3 volumes for instance.
Aug 09 19:21:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:21:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:21:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:08 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Deleted allocations for instance b806d9de-624b-4ba1-99a8-cebc2b292797
Aug 09 19:21:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc9d-a278-44ac-b90d-c022543a0904 tempest-TaggedBootDevicesTest-1974786098 tempest-TaggedBootDevicesTest-1974786098-project-member] Lock "b806d9de-624b-4ba1-99a8-cebc2b292797" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.628s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:08 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608853.61797, 618721bf-b744-4fb7-b2b9-9972d50f15ca => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:08 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] VM Stopped (Lifecycle Event)
Aug 09 19:21:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1374c5ec-5211-41b8-9e73-7f82e402036e None None] [instance: 618721bf-b744-4fb7-b2b9-9972d50f15ca] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:09 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:09 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:09 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d54b8ad-d678-4741-814e-b0d1648bc96a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:21:09 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86baf4c-6a63-40a9-bc57-318e78295e73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f] added
Aug 09 19:21:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58c642-4ab5-4c9a-8843-aed34faa2835]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f931353-98a4-4d34-9f36-b02deb30d753]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoeqNpJP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoeqNpJP" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[263acdcd-ca94-472e-b008-9c47d44126ac]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoeqNpJP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797dc01-1e0b-49d7-88a1-63707a06f6de]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e6149-e966-4a85-97cc-227e260e98a3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c799bb8-56f1-4e41-a245-a74bbe337a83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]
Aug 09 19:21:09 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd567cb-ac49-45b3-b951-cb8889bc8c23]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba5e793-ac65-4fd8-9110-b21326c656bb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:09 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:21:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d49f82-d253-45e5-acc9-48c8477bcc0a]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:21:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:21:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23465653238616439', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465653238616439', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'flavor' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:21:11 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:21:11 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:21:11 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:21:11 user nova-compute[72441]:   <serial>b8517e80-5774-43ac-8262-688c8fda0d8f</serial>
Aug 09 19:21:11 user nova-compute[72441]: </disk>
Aug 09 19:21:11 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No VIF found with MAC fa:16:3e:ce:f2:fe, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:21:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-59f0015f-e1df-4d4a-b94f-a82f6e124eb6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.929s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:13 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608858.9306438, b806d9de-624b-4ba1-99a8-cebc2b292797 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:13 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] VM Stopped (Lifecycle Event)
Aug 09 19:21:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4bfc2737-93b0-4475-b206-b53676ab0c7d None None] [instance: b806d9de-624b-4ba1-99a8-cebc2b292797] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:17 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608862.1435845, 277c7588-02fc-4ccb-bdaa-085a6c95139d => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:17 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] VM Stopped (Lifecycle Event)
Aug 09 19:21:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2d401995-3621-4f84-995c-5462666ec95c None None] [instance: 277c7588-02fc-4ccb-bdaa-085a6c95139d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:20 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:21:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'flavor' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:21 user nova-compute[72441]: INFO nova.compute.manager [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attaching volume d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 to /dev/vdb
Aug 09 19:21:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a16f0f8-aadc-4bf9-b04f-940101ad9b44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6558a76e-e051-4146-a80e-b4aa9d19056c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e685e49-5297-44dc-b49b-fcb72857bce8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[af03206b-d8c5-4919-92d5-358a785107ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:21:21 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:21:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[991a43ec-9ae7-4361-a5e6-2818a28e36ca]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:21 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating existing volume attachment record: 7d2e3355-c1d3-4a47-bfe3-67d72751f397 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-changed-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing instance network info cache due to event network-changed-01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing network info cache for port 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updated VIF entry in instance network info cache for port 01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a45bc64-258d-4871-8c3c-dd66d49abfb8 req-0c1f3b5c-6226-49c1-a298-230fa8eec5e5 service nova] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:21:24 user nova-compute[72441]: INFO nova.compute.claims [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Claim successful on node user
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-changed-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing instance network info cache due to event network-changed-01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG nova.network.neutron [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing network info cache for port 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:21:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.policy [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de57b5e4f9f54fffa53d91f9a6afd092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4468899cba1a4bfe8a68af07b58b0a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:21:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Creating image(s)
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.171s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Successfully created port: 2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.626s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:21:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7324MB free_disk=25.495121002197266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk 1073741824" returned: 0 in 0.068s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.701s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bad8b180-4469-4439-8df9-188ec39a1314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ca5376e3-fc18-4583-8fbf-1ce8490ad767 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33896e33-6002-4305-9928-e958ec21155b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 84bdfb26-f639-4431-821c-dcdbe7a55eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Cannot resize image /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'migration_context' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updated VIF entry in instance network info cache for port 01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Ensure instance console log exists: /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7d77326a-abb5-47e6-99f5-8e7f4ca7d0de req-4ae8c25d-e079-415b-804c-c1c838be3a9c service nova] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:26 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Successfully updated port: 2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-changed-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Refreshing instance network info cache due to event network-changed-2cacd5ec-a169-42d7-b356-5878fa2373ed. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance network_info: |[{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Refreshing network info cache for port 2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start _get_guest_xml network_info=[{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:21:27 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:21:27 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'pci_devices' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:21:27 user nova-compute[72441]:   <uuid>33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</uuid>
Aug 09 19:21:27 user nova-compute[72441]:   <name>instance-00000011</name>
Aug 09 19:21:27 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:21:27 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:21:27 user nova-compute[72441]:   <metadata>
Aug 09 19:21:27 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:21:27 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:21:27 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherB-server-744398493</nova:name>
Aug 09 19:21:27 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:21:27</nova:creationTime>
Aug 09 19:21:27 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:21:27 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:21:27 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:21:27 user nova-compute[72441]:       <nova:owner>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:user uuid="de57b5e4f9f54fffa53d91f9a6afd092">tempest-ServerActionsTestOtherB-804828463-project-member</nova:user>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:project uuid="4468899cba1a4bfe8a68af07b58b0a04">tempest-ServerActionsTestOtherB-804828463</nova:project>
Aug 09 19:21:27 user nova-compute[72441]:       </nova:owner>
Aug 09 19:21:27 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:21:27 user nova-compute[72441]:       <nova:ports>
Aug 09 19:21:27 user nova-compute[72441]:         <nova:port uuid="2cacd5ec-a169-42d7-b356-5878fa2373ed">
Aug 09 19:21:27 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 19:21:27 user nova-compute[72441]:         </nova:port>
Aug 09 19:21:27 user nova-compute[72441]:       </nova:ports>
Aug 09 19:21:27 user nova-compute[72441]:     </nova:instance>
Aug 09 19:21:27 user nova-compute[72441]:   </metadata>
Aug 09 19:21:27 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:21:27 user nova-compute[72441]:     <system>
Aug 09 19:21:27 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:21:27 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:21:27 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:21:27 user nova-compute[72441]:       <entry name="serial">33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</entry>
Aug 09 19:21:27 user nova-compute[72441]:       <entry name="uuid">33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</entry>
Aug 09 19:21:27 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:21:27 user nova-compute[72441]:     </system>
Aug 09 19:21:27 user nova-compute[72441]:   </sysinfo>
Aug 09 19:21:27 user nova-compute[72441]:   <os>
Aug 09 19:21:27 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:21:27 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:21:27 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:21:27 user nova-compute[72441]:   </os>
Aug 09 19:21:27 user nova-compute[72441]:   <features>
Aug 09 19:21:27 user nova-compute[72441]:     <acpi/>
Aug 09 19:21:27 user nova-compute[72441]:     <apic/>
Aug 09 19:21:27 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:21:27 user nova-compute[72441]:   </features>
Aug 09 19:21:27 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:21:27 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:21:27 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:21:27 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:21:27 user nova-compute[72441]:   </clock>
Aug 09 19:21:27 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:21:27 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:21:27 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:21:27 user nova-compute[72441]:   </cpu>
Aug 09 19:21:27 user nova-compute[72441]:   <devices>
Aug 09 19:21:27 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:21:27 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:21:27 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk"/>
Aug 09 19:21:27 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:21:27 user nova-compute[72441]:     </disk>
Aug 09 19:21:27 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:21:27 user nova-compute[72441]:       <mac address="fa:16:3e:d6:d5:a3"/>
Aug 09 19:21:27 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:21:27 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:21:27 user nova-compute[72441]:       <target dev="tap2cacd5ec-a1"/>
Aug 09 19:21:27 user nova-compute[72441]:     </interface>
Aug 09 19:21:27 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:21:27 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/console.log" append="off"/>
Aug 09 19:21:27 user nova-compute[72441]:     </serial>
Aug 09 19:21:27 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:21:27 user nova-compute[72441]:     <video>
Aug 09 19:21:27 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:21:27 user nova-compute[72441]:     </video>
Aug 09 19:21:27 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:21:27 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:21:27 user nova-compute[72441]:     </rng>
Aug 09 19:21:27 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:21:27 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:21:27 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:21:27 user nova-compute[72441]:     </memballoon>
Aug 09 19:21:27 user nova-compute[72441]:   </devices>
Aug 09 19:21:27 user nova-compute[72441]: </domain>
Aug 09 19:21:27 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG os_vif [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cacd5ec-a1, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cacd5ec-a1, col_values=(('external_ids', {'iface-id': '2cacd5ec-a169-42d7-b356-5878fa2373ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d5:a3', 'vm-uuid': '33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:27 user nova-compute[72441]: INFO os_vif [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1')
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No VIF found with MAC fa:16:3e:d6:d5:a3, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:21:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updated VIF entry in instance network info cache for port 2cacd5ec-a169-42d7-b356-5878fa2373ed. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:21:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-433539d3-327f-42cd-86ca-38914ad195b5 req-f5f9feb3-7c29-4868-8e6a-aa274fa3e1a7 service nova] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-a4896bbf-1a1a-468c-8af9-74deb6d738d1 req-f7744e76-97bd-4fa6-a449-0eca45243ae3 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a4896bbf-1a1a-468c-8af9-74deb6d738d1 req-f7744e76-97bd-4fa6-a449-0eca45243ae3 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a4896bbf-1a1a-468c-8af9-74deb6d738d1 req-f7744e76-97bd-4fa6-a449-0eca45243ae3 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a4896bbf-1a1a-468c-8af9-74deb6d738d1 req-f7744e76-97bd-4fa6-a449-0eca45243ae3 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-a4896bbf-1a1a-468c-8af9-74deb6d738d1 req-f7744e76-97bd-4fa6-a449-0eca45243ae3 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:29 user nova-compute[72441]: WARNING nova.compute.manager [req-a4896bbf-1a1a-468c-8af9-74deb6d738d1 req-f7744e76-97bd-4fa6-a449-0eca45243ae3 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state building and task_state spawning.
Aug 09 19:21:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Rebooting instance
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance spawned successfully.
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608891.4331675, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Resumed (Lifecycle Event)
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608891.4379573, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Started (Lifecycle Event)
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-9766f466-eb10-468b-8cc1-85a0f014e753 req-8b2330df-6c80-4ec4-b99f-4d69a1a07803 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9766f466-eb10-468b-8cc1-85a0f014e753 req-8b2330df-6c80-4ec4-b99f-4d69a1a07803 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9766f466-eb10-468b-8cc1-85a0f014e753 req-8b2330df-6c80-4ec4-b99f-4d69a1a07803 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9766f466-eb10-468b-8cc1-85a0f014e753 req-8b2330df-6c80-4ec4-b99f-4d69a1a07803 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-9766f466-eb10-468b-8cc1-85a0f014e753 req-8b2330df-6c80-4ec4-b99f-4d69a1a07803 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:31 user nova-compute[72441]: WARNING nova.compute.manager [req-9766f466-eb10-468b-8cc1-85a0f014e753 req-8b2330df-6c80-4ec4-b99f-4d69a1a07803 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state building and task_state spawning.
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:31 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:31 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:31 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f13034-f58b-4255-b38a-5ae2278ed62a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:21:31 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:31 user nova-compute[72441]: INFO nova.compute.manager [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Took 7.22 seconds to build instance.
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b76532f-e1db-416f-a26f-203d764b0fc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64] added
Aug 09 19:21:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b650fc66-e601-4300-9287-f53719b95f11 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.321s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8674213f-9832-4048-922b-580e17fbb6e0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7cb134-9446-4720-9179-00e20d67098c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueiFvUsp {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueiFvUsp" returned: 0 in 0.084s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d289c-b7ef-469d-9b62-626f8a2f78ae]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ueiFvUsp'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0860352-a3eb-406e-a58a-db205201203d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24c6bf-309a-49b2-8621-3203c5c5797a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:31 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:31 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:31 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:31 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59f0e2-0023-4687-aa11-5e1b4a0e9208]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]
Aug 09 19:21:32 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edccc393-6652-44f8-a3a7-597f5817b689]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13163642-c8a6-4c2e-8186-7f7861a90ce6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:32 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:32 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:32 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:32 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:32 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:32 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b1059-f080-4332-8c07-eefc6a697a26]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-e3934ef4-ccd8-46a5-a114-01e511a17126 req-e2d6d888-b842-46c0-bac6-3b6866d7b28c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-unplugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e3934ef4-ccd8-46a5-a114-01e511a17126 req-e2d6d888-b842-46c0-bac6-3b6866d7b28c service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e3934ef4-ccd8-46a5-a114-01e511a17126 req-e2d6d888-b842-46c0-bac6-3b6866d7b28c service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e3934ef4-ccd8-46a5-a114-01e511a17126 req-e2d6d888-b842-46c0-bac6-3b6866d7b28c service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-e3934ef4-ccd8-46a5-a114-01e511a17126 req-e2d6d888-b842-46c0-bac6-3b6866d7b28c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-unplugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:32 user nova-compute[72441]: WARNING nova.compute.manager [req-e3934ef4-ccd8-46a5-a114-01e511a17126 req-e2d6d888-b842-46c0-bac6-3b6866d7b28c service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-unplugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance destroyed successfully.
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.objects.instance [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'resources' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285238595',display_name='tempest-TestMinimumBasicScenario-server-285238595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285238595',id=12,image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJakhBNZG/Xp7L7bWk5jO8eaYkpuSgT8oEYtn5quizbZ92zPivsA/Ivc/77DanLCOTrX1xOg1fd24upHOeq48uf4kUA9e0mt+5rg1CJmzPzHqzvruTzm+V8BZa0heRH/HQ==',key_name='tempest-TestMinimumBasicScenario-633096993',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-qoqrisl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:21:32Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=33896e33-6002-4305-9928-e958ec21155b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b17790-db, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:32 user nova-compute[72441]: INFO os_vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db')
Aug 09 19:21:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23833333835313833', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833333835313833', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.248s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'flavor' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a07f0-9d06-40c1-a212-ca1718bb5e67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:21:33 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:21:33 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:21:33 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:21:33 user nova-compute[72441]:   <serial>d7cbf10e-2fb1-48d9-bf72-a35acaff2e64</serial>
Aug 09 19:21:33 user nova-compute[72441]: </disk>
Aug 09 19:21:33 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e34c0-c17b-4cc2-be26-e360187434ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905b7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fbb700-e53d-455a-9e34-2ff8b60e6ed5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8e1a8-09ee-4dc6-8433-d8dc4a56fa64]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be9405e-17dd-4524-bda4-36de33bd8b45]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0e13c-528c-450b-bd5b-0cb1877043fb]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7698bcfd-9ea8-4e55-be97-12badbe20e21]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ab97ee-5549-47e5-8aef-642207a0fd32]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]
Aug 09 19:21:33 user nova-compute[72441]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d92ec44-b3cb-4ed1-b485-315af3efb751]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== disconnect_volume: return (651ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Start _get_guest_xml network_info=[{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=32e95858-7fe3-43aa-bce7-59edbd58d401,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '32e95858-7fe3-43aa-bce7-59edbd58d401'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '33896e33-6002-4305-9928-e958ec21155b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8517e80-5774-43ac-8262-688c8fda0d8f', 'serial': 'b8517e80-5774-43ac-8262-688c8fda0d8f'}, 'attachment_id': '854c7607-c8f5-4995-8729-9a3accc84e50', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-changed-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Refreshing instance network info cache due to event network-changed-1961cf02-f268-49b9-8c2a-c7895522089b. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] Acquiring lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] Acquired lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Refreshing network info cache for port 1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:21:33 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:21:33 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=32e95858-7fe3-43aa-bce7-59edbd58d401,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:33 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:33 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:33 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a946317-b233-489c-92c6-85cc06710502]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:21:33 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No VIF found with MAC fa:16:3e:4a:6e:8f, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf231a4-27fb-43ce-b313-47eb222912e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f] added
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a2cb9-e879-4513-a4ff-10df14716402]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d37f62-3d12-496f-b564-cd2a03117936]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoeqNpJP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoeqNpJP" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81fe110-2ea9-42b5-b708-913c173987f1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoeqNpJP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df53d52a-9260-41b6-a48f-207d4777a81b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec4af1-c164-4f00-a838-61a8e1c3e604]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ae525bd-0d58-4eff-aeb3-f9696e97130e tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.098s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[23917400-3b69-464d-b440-8a78a86f11c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]
Aug 09 19:21:33 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4216f0-7a08-44a6-b761-30906349099e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[32285a9a-f7a6-481c-9ae5-0edb37d2bfe7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:33 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:21:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:21:33 user nova-compute[72441]: INFO nova.compute.manager [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Terminating instance
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5189db-7a1b-470e-96b0-bfb3e0e323f9]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-181ad5b7-69ef-4c01-bfaa-12274a219f5d req-47c594b8-4d0c-4bf4-8afb-390ed12a8521 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181ad5b7-69ef-4c01-bfaa-12274a219f5d req-47c594b8-4d0c-4bf4-8afb-390ed12a8521 service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181ad5b7-69ef-4c01-bfaa-12274a219f5d req-47c594b8-4d0c-4bf4-8afb-390ed12a8521 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181ad5b7-69ef-4c01-bfaa-12274a219f5d req-47c594b8-4d0c-4bf4-8afb-390ed12a8521 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-181ad5b7-69ef-4c01-bfaa-12274a219f5d req-47c594b8-4d0c-4bf4-8afb-390ed12a8521 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:34 user nova-compute[72441]: WARNING nova.compute.manager [req-181ad5b7-69ef-4c01-bfaa-12274a219f5d req-47c594b8-4d0c-4bf4-8afb-390ed12a8521 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.network.neutron [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updated VIF entry in instance network info cache for port 1961cf02-f268-49b9-8c2a-c7895522089b. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.network.neutron [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updating instance_info_cache with network_info: [{"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-5a05ceab-0d7d-45fa-af6b-a4aacb6db20c req-e14432b0-28a2-4adc-a0db-fcc28df9e59b service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-vif-unplugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5a05ceab-0d7d-45fa-af6b-a4aacb6db20c req-e14432b0-28a2-4adc-a0db-fcc28df9e59b service nova] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5a05ceab-0d7d-45fa-af6b-a4aacb6db20c req-e14432b0-28a2-4adc-a0db-fcc28df9e59b service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5a05ceab-0d7d-45fa-af6b-a4aacb6db20c req-e14432b0-28a2-4adc-a0db-fcc28df9e59b service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-5a05ceab-0d7d-45fa-af6b-a4aacb6db20c req-e14432b0-28a2-4adc-a0db-fcc28df9e59b service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] No waiting events found dispatching network-vif-unplugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-5a05ceab-0d7d-45fa-af6b-a4aacb6db20c req-e14432b0-28a2-4adc-a0db-fcc28df9e59b service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-vif-unplugged-1961cf02-f268-49b9-8c2a-c7895522089b for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-26217944-69df-4423-a2ce-83402e8bb830 req-056abc61-ac1b-4e3d-aeca-03b41929503a service nova] Releasing lock "refresh_cache-ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:21:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Instance destroyed successfully.
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'resources' on Instance uuid ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-52447389',display_name='tempest-AttachVolumeNegativeTest-server-52447389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-52447389',id=13,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyRlFy5rqpV1X161eP6dQ5HyMX0/Q9Zw9bEen+S5eanrF2IZSGlw26+OoTS+kT00odBx4/wZAOPHhwtlMXi/Ciymf3PotXFEfmcg8q9w+lMSSwvt8BemyFUV6oxg+1FHQ==',key_name='tempest-keypair-1270984834',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-xglaee6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "1961cf02-f268-49b9-8c2a-c7895522089b", "address": "fa:16:3e:f9:26:4b", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1961cf02-f2", "ovs_interfaceid": "1961cf02-f268-49b9-8c2a-c7895522089b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG os_vif [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1961cf02-f2, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:34 user nova-compute[72441]: INFO os_vif [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:26:4b,bridge_name='br-int',has_traffic_filtering=True,id=1961cf02-f268-49b9-8c2a-c7895522089b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1961cf02-f2')
Aug 09 19:21:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Deleting instance files /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf_del
Aug 09 19:21:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Deletion of /opt/stack/data/nova/instances/ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf_del complete
Aug 09 19:21:34 user nova-compute[72441]: INFO nova.compute.manager [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 19:21:34 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:21:34 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23465653238616439', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465653238616439', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285238595',display_name='tempest-TestMinimumBasicScenario-server-285238595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285238595',id=12,image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJakhBNZG/Xp7L7bWk5jO8eaYkpuSgT8oEYtn5quizbZ92zPivsA/Ivc/77DanLCOTrX1xOg1fd24upHOeq48uf4kUA9e0mt+5rg1CJmzPzHqzvruTzm+V8BZa0heRH/HQ==',key_name='tempest-TestMinimumBasicScenario-633096993',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-qoqrisl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:21:32Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=33896e33-6002-4305-9928-e958ec21155b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'pci_devices' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:21:35 user nova-compute[72441]:   <uuid>33896e33-6002-4305-9928-e958ec21155b</uuid>
Aug 09 19:21:35 user nova-compute[72441]:   <name>instance-0000000c</name>
Aug 09 19:21:35 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:21:35 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:21:35 user nova-compute[72441]:   <metadata>
Aug 09 19:21:35 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:21:35 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:21:35 user nova-compute[72441]:       <nova:name>tempest-TestMinimumBasicScenario-server-285238595</nova:name>
Aug 09 19:21:35 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:21:33</nova:creationTime>
Aug 09 19:21:35 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:21:35 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:21:35 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:21:35 user nova-compute[72441]:       <nova:owner>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:user uuid="7ba704de696a49258532080173d23fd5">tempest-TestMinimumBasicScenario-2005926422-project-member</nova:user>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:project uuid="94c2820770744df88c94474a2ad02e77">tempest-TestMinimumBasicScenario-2005926422</nova:project>
Aug 09 19:21:35 user nova-compute[72441]:       </nova:owner>
Aug 09 19:21:35 user nova-compute[72441]:       <nova:root type="image" uuid="32e95858-7fe3-43aa-bce7-59edbd58d401"/>
Aug 09 19:21:35 user nova-compute[72441]:       <nova:ports>
Aug 09 19:21:35 user nova-compute[72441]:         <nova:port uuid="01b17790-db81-4033-ac01-698aeece1f58">
Aug 09 19:21:35 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:21:35 user nova-compute[72441]:         </nova:port>
Aug 09 19:21:35 user nova-compute[72441]:       </nova:ports>
Aug 09 19:21:35 user nova-compute[72441]:     </nova:instance>
Aug 09 19:21:35 user nova-compute[72441]:   </metadata>
Aug 09 19:21:35 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:21:35 user nova-compute[72441]:     <system>
Aug 09 19:21:35 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:21:35 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:21:35 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:21:35 user nova-compute[72441]:       <entry name="serial">33896e33-6002-4305-9928-e958ec21155b</entry>
Aug 09 19:21:35 user nova-compute[72441]:       <entry name="uuid">33896e33-6002-4305-9928-e958ec21155b</entry>
Aug 09 19:21:35 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:21:35 user nova-compute[72441]:     </system>
Aug 09 19:21:35 user nova-compute[72441]:   </sysinfo>
Aug 09 19:21:35 user nova-compute[72441]:   <os>
Aug 09 19:21:35 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:21:35 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:21:35 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:21:35 user nova-compute[72441]:   </os>
Aug 09 19:21:35 user nova-compute[72441]:   <features>
Aug 09 19:21:35 user nova-compute[72441]:     <acpi/>
Aug 09 19:21:35 user nova-compute[72441]:     <apic/>
Aug 09 19:21:35 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:21:35 user nova-compute[72441]:   </features>
Aug 09 19:21:35 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:21:35 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:21:35 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:21:35 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:21:35 user nova-compute[72441]:   </clock>
Aug 09 19:21:35 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:21:35 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:21:35 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:21:35 user nova-compute[72441]:   </cpu>
Aug 09 19:21:35 user nova-compute[72441]:   <devices>
Aug 09 19:21:35 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:21:35 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:21:35 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk"/>
Aug 09 19:21:35 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:21:35 user nova-compute[72441]:     </disk>
Aug 09 19:21:35 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:21:35 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:21:35 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:21:35 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:21:35 user nova-compute[72441]:       <serial>b8517e80-5774-43ac-8262-688c8fda0d8f</serial>
Aug 09 19:21:35 user nova-compute[72441]:     </disk>
Aug 09 19:21:35 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:21:35 user nova-compute[72441]:       <mac address="fa:16:3e:ce:f2:fe"/>
Aug 09 19:21:35 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:21:35 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:21:35 user nova-compute[72441]:       <target dev="tap01b17790-db"/>
Aug 09 19:21:35 user nova-compute[72441]:     </interface>
Aug 09 19:21:35 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:21:35 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/console.log" append="off"/>
Aug 09 19:21:35 user nova-compute[72441]:     </serial>
Aug 09 19:21:35 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:21:35 user nova-compute[72441]:     <video>
Aug 09 19:21:35 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:21:35 user nova-compute[72441]:     </video>
Aug 09 19:21:35 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:21:35 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:21:35 user nova-compute[72441]:     </rng>
Aug 09 19:21:35 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:21:35 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:21:35 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:21:35 user nova-compute[72441]:     </memballoon>
Aug 09 19:21:35 user nova-compute[72441]:   </devices>
Aug 09 19:21:35 user nova-compute[72441]: </domain>
Aug 09 19:21:35 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:35 user nova-compute[72441]: INFO nova.compute.manager [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Rebuilding instance
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'trusted_certs' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'pci_requests' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'pci_devices' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'resources' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Cannot resize image /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'migration_context' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285238595',display_name='tempest-TestMinimumBasicScenario-server-285238595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285238595',id=12,image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJakhBNZG/Xp7L7bWk5jO8eaYkpuSgT8oEYtn5quizbZ92zPivsA/Ivc/77DanLCOTrX1xOg1fd24upHOeq48uf4kUA9e0mt+5rg1CJmzPzHqzvruTzm+V8BZa0heRH/HQ==',key_name='tempest-TestMinimumBasicScenario-633096993',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-qoqrisl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:21:32Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=33896e33-6002-4305-9928-e958ec21155b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG os_vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'migration_context' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b17790-db, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01b17790-db, col_values=(('external_ids', {'iface-id': '01b17790-db81-4033-ac01-698aeece1f58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f2:fe', 'vm-uuid': '33896e33-6002-4305-9928-e958ec21155b'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72441) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: INFO os_vif [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db')
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:36 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Took 1.28 seconds to deallocate network for instance.
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-a7bb001e-e191-41f9-ab04-7c57b221d884 req-88920d15-623c-4e3c-954b-8eece6250c87 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-vif-deleted-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:36 user nova-compute[72441]: INFO nova.compute.manager [req-a7bb001e-e191-41f9-ab04-7c57b221d884 req-88920d15-623c-4e3c-954b-8eece6250c87 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Neutron deleted interface 1961cf02-f268-49b9-8c2a-c7895522089b; detaching it from the instance and deleting it from the info cache
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.network.neutron [req-a7bb001e-e191-41f9-ab04-7c57b221d884 req-88920d15-623c-4e3c-954b-8eece6250c87 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-a7bb001e-e191-41f9-ab04-7c57b221d884 req-88920d15-623c-4e3c-954b-8eece6250c87 service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Detach interface failed, port_id=1961cf02-f268-49b9-8c2a-c7895522089b, reason: Instance ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-unplugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-unplugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:36 user nova-compute[72441]: WARNING nova.compute.manager [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-unplugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state active and task_state rebuilding.
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:36 user nova-compute[72441]: WARNING nova.compute.manager [req-ba484f73-aa71-4d97-be4e-eff55a8346da req-a7938760-c174-40fb-9a65-8b590bfc1655 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state active and task_state rebuilding.
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-009b9ca3-65f5-46f7-8ecd-9d17fd51919a req-045d506b-dd1b-49a6-94fc-4c3e74eed7ca service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received event network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-009b9ca3-65f5-46f7-8ecd-9d17fd51919a req-045d506b-dd1b-49a6-94fc-4c3e74eed7ca service nova] Acquiring lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-009b9ca3-65f5-46f7-8ecd-9d17fd51919a req-045d506b-dd1b-49a6-94fc-4c3e74eed7ca service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-009b9ca3-65f5-46f7-8ecd-9d17fd51919a req-045d506b-dd1b-49a6-94fc-4c3e74eed7ca service nova] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-009b9ca3-65f5-46f7-8ecd-9d17fd51919a req-045d506b-dd1b-49a6-94fc-4c3e74eed7ca service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] No waiting events found dispatching network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:36 user nova-compute[72441]: WARNING nova.compute.manager [req-009b9ca3-65f5-46f7-8ecd-9d17fd51919a req-045d506b-dd1b-49a6-94fc-4c3e74eed7ca service nova] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Received unexpected event network-vif-plugged-1961cf02-f268-49b9-8c2a-c7895522089b for instance with vm_state deleted and task_state None.
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:21:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.742s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:37 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Deleted allocations for instance ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a49aa096-6f16-4649-8b8b-988773dcce29 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:37 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance destroyed successfully.
Aug 09 19:21:37 user nova-compute[72441]: INFO nova.compute.manager [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Detaching volume d7cbf10e-2fb1-48d9-bf72-a35acaff2e64
Aug 09 19:21:37 user nova-compute[72441]: INFO nova.virt.block_device [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attempting to driver detach volume d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 from mountpoint /dev/vdb
Aug 09 19:21:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Attempting to detach device vdb from instance 822fd908-82ec-4e6c-bcab-b190213e67e7 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:21:37 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:21:37 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:21:37 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:21:37 user nova-compute[72441]:   <serial>d7cbf10e-2fb1-48d9-bf72-a35acaff2e64</serial>
Aug 09 19:21:37 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:21:37 user nova-compute[72441]: </disk>
Aug 09 19:21:37 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:21:37 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully detached device vdb from instance 822fd908-82ec-4e6c-bcab-b190213e67e7 from the persistent domain config.
Aug 09 19:21:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:37 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750168e-ee5d-4d22-842f-b50f8fd8917a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f70b31-4702-455b-ad71-a7816f953f25]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:37 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:37 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:37 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:37 user nova-compute[72441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:37 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:37 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905b4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f28afb-195b-46f7-908f-603786aa2b78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6990265-d4ea-4938-bf2d-f339c04d5b1e]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[190500ab-c9b2-4a61-8487-7589dd9c2f38]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f9aca4-ed28-48a0-bbda-0dd77c61a8c6]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0defde5-70b6-4e69-bf3e-dd00d5598f1d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25bdcb0-2e58-4166-8d25-ff90543a6fc3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]
Aug 09 19:21:37 user nova-compute[72441]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d75ee-5aac-4a52-92b3-c51b77974cee]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== disconnect_volume: return (328ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:38 user nova-compute[72441]: WARNING nova.compute.manager [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:38 user nova-compute[72441]: WARNING nova.compute.manager [req-5221b5e7-e95f-4c46-a292-da1d1182a6a0 req-2a92091e-31bf-4c11-bbe2-62d154561004 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 19:21:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance destroyed successfully.
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028222133',display_name='tempest-ServerActionsTestOtherA-server-521700190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028222133',id=4,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1szv9zr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=822fd908-82ec-4e6c-bcab-b190213e67e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaae0b6a1-41, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:38 user nova-compute[72441]: INFO os_vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41')
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:38 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7026c0-fbb2-4357-a5a6-3f6647142885]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c986066f-3b0f-496e-bbe1-08ee2c157521]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:38 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:38 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:38 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:38 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:38 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:38 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905b7760>, {}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Disconnecting from: [] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== disconnect_volume: return (53ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:21:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Deleting instance files /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7_del
Aug 09 19:21:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Deletion of /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7_del complete
Aug 09 19:21:38 user nova-compute[72441]: INFO nova.virt.block_device [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Booting with volume d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 at /dev/vdb
Aug 09 19:21:39 user nova-compute[72441]: DEBUG os_brick.utils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63770cc8-a1bb-458a-9da0-9444845e5ca7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40dfe0-16d0-4b31-a288-9984b4faa212]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4169b647-a3fc-4040-ba32-6cd12b1eb93b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33486efa-e892-41a5-b574-0747e561730a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:21:39 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[490e524a-5731-4c49-a354-cd7ba7954a8e]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG os_brick.utils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating existing volume attachment record: 7bd2006f-31ce-44c2-92e3-e254729f1cda {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:39 user nova-compute[72441]: INFO nova.compute.manager [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Terminating instance
Aug 09 19:21:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-c7c12e66-6e2d-4e47-ae6d-fef0af912c18 req-3b619d23-fe95-4a75-bc94-1a42e793aaf9 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-unplugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c7c12e66-6e2d-4e47-ae6d-fef0af912c18 req-3b619d23-fe95-4a75-bc94-1a42e793aaf9 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c7c12e66-6e2d-4e47-ae6d-fef0af912c18 req-3b619d23-fe95-4a75-bc94-1a42e793aaf9 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c7c12e66-6e2d-4e47-ae6d-fef0af912c18 req-3b619d23-fe95-4a75-bc94-1a42e793aaf9 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-c7c12e66-6e2d-4e47-ae6d-fef0af912c18 req-3b619d23-fe95-4a75-bc94-1a42e793aaf9 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-unplugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-c7c12e66-6e2d-4e47-ae6d-fef0af912c18 req-3b619d23-fe95-4a75-bc94-1a42e793aaf9 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-unplugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 33896e33-6002-4305-9928-e958ec21155b due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608900.039006, 33896e33-6002-4305-9928-e958ec21155b => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] VM Resumed (Lifecycle Event)
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance rebooted successfully.
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608900.0617106, 33896e33-6002-4305-9928-e958ec21155b => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] VM Started (Lifecycle Event)
Aug 09 19:21:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-94f69575-fc12-4ef4-9515-306fb5b350f6 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.072s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Instance destroyed successfully.
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.objects.instance [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lazy-loading 'resources' on Instance uuid ca5376e3-fc18-4583-8fbf-1ce8490ad767 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-798529792',display_name='tempest-TestVolumeSwap-server-798529792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-798529792',id=8,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGf8Zo9RiUIYZ/+MsSpa7C0fjMvHDPohWBWmqOO4lMCiykTC1vruBC0LUD4kVGNNGEtkGD/TbBFhvEfE5DTnOWin7UI/Erh9YVWrQI67XlydgP8jUsz6AI8ZiH3oypxLA==',key_name='tempest-keypair-1540276229',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8cda3a1fbad429cb93fbd8c3f0a21b4',ramdisk_id='',reservation_id='r-95uv0ma0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-122912092',owner_user_name='tempest-TestVolumeSwap-122912092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adcc28c7b05f4da6ad35d196c5f338f0',uuid=ca5376e3-fc18-4583-8fbf-1ce8490ad767,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Converting VIF {"id": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "address": "fa:16:3e:95:cd:a6", "network": {"id": "76a71c6f-f717-4168-ac93-b5daa2b6abb9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-622791540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8cda3a1fbad429cb93fbd8c3f0a21b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b55e52a-97", "ovs_interfaceid": "9b55e52a-9733-4e1c-a2f5-75082680aa4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG os_vif [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b55e52a-97, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:40 user nova-compute[72441]: INFO os_vif [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cd:a6,bridge_name='br-int',has_traffic_filtering=True,id=9b55e52a-9733-4e1c-a2f5-75082680aa4d,network=Network(76a71c6f-f717-4168-ac93-b5daa2b6abb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b55e52a-97')
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Deleting instance files /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767_del
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Deletion of /opt/stack/data/nova/instances/ca5376e3-fc18-4583-8fbf-1ce8490ad767_del complete
Aug 09 19:21:40 user nova-compute[72441]: INFO nova.compute.manager [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 19:21:40 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:21:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:41 user nova-compute[72441]: WARNING nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received unexpected event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with vm_state active and task_state deleting.
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:41 user nova-compute[72441]: WARNING nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received unexpected event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with vm_state active and task_state deleting.
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:41 user nova-compute[72441]: WARNING nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received unexpected event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with vm_state active and task_state deleting.
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-unplugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-unplugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-d7b3267b-c6a8-49b6-a816-70ae23853ced req-3816eb9c-eeaa-420e-9200-6759e59ccf30 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-unplugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:21:42 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:21:42 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Took 1.76 seconds to deallocate network for instance.
Aug 09 19:21:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:42 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:21:42 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:21:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:42 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Deleted allocations for instance ca5376e3-fc18-4583-8fbf-1ce8490ad767
Aug 09 19:21:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83def2a8-d7a9-4a17-a460-cdac3258bd3f tempest-TestVolumeSwap-122912092 tempest-TestVolumeSwap-122912092-project-member] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.562s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] Acquiring lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] Lock "ca5376e3-fc18-4583-8fbf-1ce8490ad767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] No waiting events found dispatching network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:43 user nova-compute[72441]: WARNING nova.compute.manager [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received unexpected event network-vif-plugged-9b55e52a-9733-4e1c-a2f5-75082680aa4d for instance with vm_state deleted and task_state None.
Aug 09 19:21:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-6b953b9c-4168-47e2-8563-c2190c2902d6 req-99ed3692-2f98-4323-b630-9eeabe80bf67 service nova] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Received event network-vif-deleted-9b55e52a-9733-4e1c-a2f5-75082680aa4d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:21:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Creating image(s)
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.130s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608894.7831933, ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:49 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] VM Stopped (Lifecycle Event)
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk 1073741824" returned: 0 in 0.060s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-380a935f-dc08-4d49-81b0-5137b844c0d3 None None] [instance: ae7c9a6f-91f9-471e-8bf1-a04ed1308eaf] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:21:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Cannot resize image /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Ensure instance console log exists: /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Start _get_guest_xml network_info=[{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '822fd908-82ec-4e6c-bcab-b190213e67e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7cbf10e-2fb1-48d9-bf72-a35acaff2e64', 'serial': 'd7cbf10e-2fb1-48d9-bf72-a35acaff2e64'}, 'attachment_id': '7bd2006f-31ce-44c2-92e3-e254729f1cda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:21:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 19:21:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'vcpu_model' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:21:50 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:50 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:21:50 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf01a0e0-279a-4d97-bbc5-2b46fd7435a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:21:50 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c50ed26-5c42-4ce1-a926-49c39aa51c23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64] added
Aug 09 19:21:50 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99058861-d48b-4e4f-a737-662b6812c96c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc37f0-114c-4f9e-b23f-49bb62a3bbac]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueiFvUsp {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueiFvUsp" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd04967-b101-4d09-b5e7-cec00353772d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ueiFvUsp'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[119b94a4-c0e4-454a-999b-29c327fda345]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4833791f-b0bb-45af-b1c8-1618e0812113]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b415624-c11d-4a34-8422-1f4bc7e3b6f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]
Aug 09 19:21:50 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.
Aug 09 19:21:50 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30eebe2-3126-45b7-9c8d-6a06834ec4c4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[241828e7-51de-4d2d-8266-b9b91d80adba]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:21:50 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d434c-0796-44a5-b3d7-8be45e870d1a]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:21:50 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23833333835313833', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833333835313833', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028222133',display_name='tempest-ServerActionsTestOtherA-server-521700190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028222133',id=4,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1szv9zr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=822fd908-82ec-4e6c-bcab-b190213e67e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:21:51 user nova-compute[72441]:   <uuid>822fd908-82ec-4e6c-bcab-b190213e67e7</uuid>
Aug 09 19:21:51 user nova-compute[72441]:   <name>instance-00000004</name>
Aug 09 19:21:51 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:21:51 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:21:51 user nova-compute[72441]:   <metadata>
Aug 09 19:21:51 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:21:51 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:21:51 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherA-server-521700190</nova:name>
Aug 09 19:21:51 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:21:50</nova:creationTime>
Aug 09 19:21:51 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:21:51 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:21:51 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:21:51 user nova-compute[72441]:       <nova:owner>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:user uuid="b6d604b2b0d64d9285df9088ee2e8c80">tempest-ServerActionsTestOtherA-683008927-project-member</nova:user>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:project uuid="4775870464a74454992c156806470beb">tempest-ServerActionsTestOtherA-683008927</nova:project>
Aug 09 19:21:51 user nova-compute[72441]:       </nova:owner>
Aug 09 19:21:51 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:21:51 user nova-compute[72441]:       <nova:ports>
Aug 09 19:21:51 user nova-compute[72441]:         <nova:port uuid="aae0b6a1-4106-4bbe-b283-e728f6dca34e">
Aug 09 19:21:51 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 19:21:51 user nova-compute[72441]:         </nova:port>
Aug 09 19:21:51 user nova-compute[72441]:       </nova:ports>
Aug 09 19:21:51 user nova-compute[72441]:     </nova:instance>
Aug 09 19:21:51 user nova-compute[72441]:   </metadata>
Aug 09 19:21:51 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:21:51 user nova-compute[72441]:     <system>
Aug 09 19:21:51 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:21:51 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:21:51 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:21:51 user nova-compute[72441]:       <entry name="serial">822fd908-82ec-4e6c-bcab-b190213e67e7</entry>
Aug 09 19:21:51 user nova-compute[72441]:       <entry name="uuid">822fd908-82ec-4e6c-bcab-b190213e67e7</entry>
Aug 09 19:21:51 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:21:51 user nova-compute[72441]:     </system>
Aug 09 19:21:51 user nova-compute[72441]:   </sysinfo>
Aug 09 19:21:51 user nova-compute[72441]:   <os>
Aug 09 19:21:51 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:21:51 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:21:51 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:21:51 user nova-compute[72441]:   </os>
Aug 09 19:21:51 user nova-compute[72441]:   <features>
Aug 09 19:21:51 user nova-compute[72441]:     <acpi/>
Aug 09 19:21:51 user nova-compute[72441]:     <apic/>
Aug 09 19:21:51 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:21:51 user nova-compute[72441]:   </features>
Aug 09 19:21:51 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:21:51 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:21:51 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:21:51 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:21:51 user nova-compute[72441]:   </clock>
Aug 09 19:21:51 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:21:51 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:21:51 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:21:51 user nova-compute[72441]:   </cpu>
Aug 09 19:21:51 user nova-compute[72441]:   <devices>
Aug 09 19:21:51 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:21:51 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:21:51 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk"/>
Aug 09 19:21:51 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:21:51 user nova-compute[72441]:     </disk>
Aug 09 19:21:51 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:21:51 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:21:51 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:21:51 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:21:51 user nova-compute[72441]:       <serial>d7cbf10e-2fb1-48d9-bf72-a35acaff2e64</serial>
Aug 09 19:21:51 user nova-compute[72441]:     </disk>
Aug 09 19:21:51 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:21:51 user nova-compute[72441]:       <mac address="fa:16:3e:4a:6e:8f"/>
Aug 09 19:21:51 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:21:51 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:21:51 user nova-compute[72441]:       <target dev="tapaae0b6a1-41"/>
Aug 09 19:21:51 user nova-compute[72441]:     </interface>
Aug 09 19:21:51 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:21:51 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/console.log" append="off"/>
Aug 09 19:21:51 user nova-compute[72441]:     </serial>
Aug 09 19:21:51 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:21:51 user nova-compute[72441]:     <video>
Aug 09 19:21:51 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:21:51 user nova-compute[72441]:     </video>
Aug 09 19:21:51 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:21:51 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:21:51 user nova-compute[72441]:     </rng>
Aug 09 19:21:51 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:21:51 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:21:51 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:21:51 user nova-compute[72441]:     </memballoon>
Aug 09 19:21:51 user nova-compute[72441]:   </devices>
Aug 09 19:21:51 user nova-compute[72441]: </domain>
Aug 09 19:21:51 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028222133',display_name='tempest-ServerActionsTestOtherA-server-521700190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028222133',id=4,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1szv9zr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=822fd908-82ec-4e6c-bcab-b190213e67e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG os_vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaae0b6a1-41, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaae0b6a1-41, col_values=(('external_ids', {'iface-id': 'aae0b6a1-4106-4bbe-b283-e728f6dca34e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:6e:8f', 'vm-uuid': '822fd908-82ec-4e6c-bcab-b190213e67e7'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:51 user nova-compute[72441]: INFO os_vif [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41')
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:21:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No VIF found with MAC fa:16:3e:4a:6e:8f, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:21:52 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608897.2421298, 822fd908-82ec-4e6c-bcab-b190213e67e7 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:52 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] VM Stopped (Lifecycle Event)
Aug 09 19:21:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2d3875d3-d2f3-442b-bc98-377f3a027b2f None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-33dddba4-1a63-4cf9-9a0c-8d4172569e51 req-4fe217a1-d57e-4d22-b0e8-9cb93062550d service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-33dddba4-1a63-4cf9-9a0c-8d4172569e51 req-4fe217a1-d57e-4d22-b0e8-9cb93062550d service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-33dddba4-1a63-4cf9-9a0c-8d4172569e51 req-4fe217a1-d57e-4d22-b0e8-9cb93062550d service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-33dddba4-1a63-4cf9-9a0c-8d4172569e51 req-4fe217a1-d57e-4d22-b0e8-9cb93062550d service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-33dddba4-1a63-4cf9-9a0c-8d4172569e51 req-4fe217a1-d57e-4d22-b0e8-9cb93062550d service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:53 user nova-compute[72441]: WARNING nova.compute.manager [req-33dddba4-1a63-4cf9-9a0c-8d4172569e51 req-4fe217a1-d57e-4d22-b0e8-9cb93062550d service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state active and task_state rebuild_spawning.
Aug 09 19:21:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608900.374408, ca5376e3-fc18-4583-8fbf-1ce8490ad767 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:55 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] VM Stopped (Lifecycle Event)
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3a6aaab4-dec9-4222-bfae-1ecde86a0415 None None] [instance: ca5376e3-fc18-4583-8fbf-1ce8490ad767] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9c8ab34-6a0e-44f9-8c85-72b2b0e990d7 req-7708d319-cc4e-407f-b3a8-470a32108d8e service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9c8ab34-6a0e-44f9-8c85-72b2b0e990d7 req-7708d319-cc4e-407f-b3a8-470a32108d8e service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9c8ab34-6a0e-44f9-8c85-72b2b0e990d7 req-7708d319-cc4e-407f-b3a8-470a32108d8e service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9c8ab34-6a0e-44f9-8c85-72b2b0e990d7 req-7708d319-cc4e-407f-b3a8-470a32108d8e service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9c8ab34-6a0e-44f9-8c85-72b2b0e990d7 req-7708d319-cc4e-407f-b3a8-470a32108d8e service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:21:55 user nova-compute[72441]: WARNING nova.compute.manager [req-d9c8ab34-6a0e-44f9-8c85-72b2b0e990d7 req-7708d319-cc4e-407f-b3a8-470a32108d8e service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state active and task_state rebuild_spawning.
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608915.6553078, 822fd908-82ec-4e6c-bcab-b190213e67e7 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:55 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] VM Resumed (Lifecycle Event)
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:21:55 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance spawned successfully.
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:21:55 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608915.6584609, 822fd908-82ec-4e6c-bcab-b190213e67e7 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:21:55 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] VM Started (Lifecycle Event)
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:21:55 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72441) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 19:21:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f4c26ea0-74a9-413e-a028-570e72f7b99c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:21:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:21:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:14 user nova-compute[72441]: INFO nova.compute.manager [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Rescuing
Aug 09 19:22:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:22:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-49e0a7c6-eae5-494c-8d36-27024f654025 req-56b72e31-52cc-4d62-ba57-751dd5cf1c12 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-49e0a7c6-eae5-494c-8d36-27024f654025 req-56b72e31-52cc-4d62-ba57-751dd5cf1c12 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-49e0a7c6-eae5-494c-8d36-27024f654025 req-56b72e31-52cc-4d62-ba57-751dd5cf1c12 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-49e0a7c6-eae5-494c-8d36-27024f654025 req-56b72e31-52cc-4d62-ba57-751dd5cf1c12 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-49e0a7c6-eae5-494c-8d36-27024f654025 req-56b72e31-52cc-4d62-ba57-751dd5cf1c12 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:16 user nova-compute[72441]: WARNING nova.compute.manager [req-49e0a7c6-eae5-494c-8d36-27024f654025 req-56b72e31-52cc-4d62-ba57-751dd5cf1c12 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state active and task_state rescuing.
Aug 09 19:22:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance destroyed successfully.
Aug 09 19:22:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Attempting a stable device rescue
Aug 09 19:22:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:22:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Creating image(s)
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "4c39ab3db63c18879c9510bbc2aa018029695f21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4c39ab3db63c18879c9510bbc2aa018029695f21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.part --force-share --output=json" returned: 0 in 0.158s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:17 user nova-compute[72441]: DEBUG nova.virt.images [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] 5fbdd37e-878c-45d0-8f1d-dd00bed5ed12 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:22:17 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:22:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.part /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.part /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.converted" returned: 0 in 0.192s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb2668a4-a0c6-4ad9-8a39-759fb351b91f req-c1ba4be5-1552-4aa9-9fbf-fe59cbb792a3 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb2668a4-a0c6-4ad9-8a39-759fb351b91f req-c1ba4be5-1552-4aa9-9fbf-fe59cbb792a3 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb2668a4-a0c6-4ad9-8a39-759fb351b91f req-c1ba4be5-1552-4aa9-9fbf-fe59cbb792a3 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb2668a4-a0c6-4ad9-8a39-759fb351b91f req-c1ba4be5-1552-4aa9-9fbf-fe59cbb792a3 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb2668a4-a0c6-4ad9-8a39-759fb351b91f req-c1ba4be5-1552-4aa9-9fbf-fe59cbb792a3 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:18 user nova-compute[72441]: WARNING nova.compute.manager [req-cb2668a4-a0c6-4ad9-8a39-759fb351b91f req-c1ba4be5-1552-4aa9-9fbf-fe59cbb792a3 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state active and task_state rescuing.
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4c39ab3db63c18879c9510bbc2aa018029695f21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.723s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "4c39ab3db63c18879c9510bbc2aa018029695f21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4c39ab3db63c18879c9510bbc2aa018029695f21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21 --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21,backing_fmt=raw /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21,backing_fmt=raw /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue" returned: 0 in 0.082s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4c39ab3db63c18879c9510bbc2aa018029695f21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'migration_context' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Start _get_guest_xml network_info=[{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "vif_mac": "fa:16:3e:ba:da:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5fbdd37e-878c-45d0-8f1d-dd00bed5ed12', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '4eb07fb7-1056-44f7-a6df-c2d42c64c393', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbbff22c-817c-48f7-b3d6-0a0daf1fa632', 'serial': 'cbbff22c-817c-48f7-b3d6-0a0daf1fa632'}, 'attachment_id': '8407f5b3-01e0-4b27-bebd-ebd2e54acc6b', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'resources' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'numa_topology' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:18 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:18 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:22:18 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:22:18 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:22:18 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa2106-02f8-4205-8770-f8eb0c2c030e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fLYXDxHG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 19:22:18 user nova-compute[72441]: node.name = iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632
Aug 09 19:22:18 user nova-compute[72441]: node.tpgt = -1
Aug 09 19:22:18 user nova-compute[72441]: node.startup = automatic
Aug 09 19:22:18 user nova-compute[72441]: node.leading_login = No
Aug 09 19:22:18 user nova-compute[72441]: iface.iscsi_ifacename = default
Aug 09 19:22:18 user nova-compute[72441]: iface.net_ifacename = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.ipaddress = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.prefix_len = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.hwaddress = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.transport_name = tcp
Aug 09 19:22:18 user nova-compute[72441]: iface.initiatorname = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.vlan_id = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.vlan_priority = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.vlan_state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.iface_num = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.mtu = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.port = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.bootproto = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.subnet_mask = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.gateway = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_alt_client_id = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_dns = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_learn_iqn = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_vendor_id_state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_vendor_id = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.dhcp_slp_da = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.fragmentation = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.gratuitous_arp = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.incoming_forwarding = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.tos_state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.tos = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.ttl = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.delayed_ack = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.tcp_nagle = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.tcp_wsf_state = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.tcp_wsf = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.tcp_timer_scale = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.tcp_timestamp = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.redirect = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.def_task_mgmt_timeout = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.header_digest = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.data_digest = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.immediate_data = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.initial_r2t = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.data_seq_inorder = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.data_pdu_inorder = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.erl = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.max_receive_data_len = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.first_burst_len = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.max_outstanding_r2t = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.max_burst_len = 0
Aug 09 19:22:18 user nova-compute[72441]: iface.chap_auth = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.bidi_chap = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.strict_login_compliance = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.discovery_auth = <empty>
Aug 09 19:22:18 user nova-compute[72441]: iface.discovery_logout = <empty>
Aug 09 19:22:18 user nova-compute[72441]: node.discovery_address = <empty>
Aug 09 19:22:18 user nova-compute[72441]: node.discovery_port = 0
Aug 09 19:22:18 user nova-compute[72441]: node.discovery_type = static
Aug 09 19:22:18 user nova-compute[72441]: node.session.initial_cmdsn = 0
Aug 09 19:22:18 user nova-compute[72441]: node.session.initial_login_retry_max = 8
Aug 09 19:22:18 user nova-compute[72441]: node.session.xmit_thread_priority = -20
Aug 09 19:22:18 user nova-compute[72441]: node.session.cmds_max = 128
Aug 09 19:22:18 user nova-compute[72441]: node.session.queue_depth = 32
Aug 09 19:22:18 user nova-compute[72441]: node.session.nr_sessions = 1
Aug 09 19:22:18 user nova-compute[72441]: node.session.auth.authmethod = CHAP
Aug 09 19:22:18 user nova-compute[72441]: node.session.auth.username = fLYXDxHG
Aug 09 19:22:18 user nova-compute[72441]: node.session.auth.password = ***
Aug 09 19:22:18 user nova-compute[72441]: node.session.auth.username_in = <empty>
Aug 09 19:22:18 user nova-compute[72441]: node.session.auth.password_in = <empty>
Aug 09 19:22:18 user nova-compute[72441]: node.session.auth.chap_algs = MD5
Aug 09 19:22:18 user nova-compute[72441]: node.session.timeo.replacement_timeout = 120
Aug 09 19:22:18 user nova-compute[72441]: node.session.err_timeo.abort_timeout = 15
Aug 09 19:22:18 user nova-compute[72441]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 19:22:18 user nova-compute[72441]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 19:22:18 user nova-compute[72441]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.FastAbort = Yes
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.InitialR2T = No
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.ImmediateData = Yes
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.MaxConnections = 1
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 19:22:18 user nova-compute[72441]: node.session.iscsi.ERL = 0
Aug 09 19:22:18 user nova-compute[72441]: node.session.scan = manual
Aug 09 19:22:18 user nova-compute[72441]: node.session.reopen_max = 0
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].address = 172.16.0.220
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].port = 3260
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].startup = manual
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].tcp.window_size = 524288
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].tcp.type_of_service = 0
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].timeo.logout_timeout = 15
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].timeo.login_timeout = 15
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].timeo.auth_timeout = 45
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].iscsi.DataDigest = None
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].iscsi.IFMarker = No
Aug 09 19:22:18 user nova-compute[72441]: node.conn[0].iscsi.OFMarker = No
Aug 09 19:22:18 user nova-compute[72441]: # END RECORD
Aug 09 19:22:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[239235e9-1fb5-4e5f-920d-e68f85c3c5b5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b723fd2c-dcc0-4a2d-ad9a-7627c0c7761e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLYXDxHG {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLYXDxHG" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da63c9e-97c6-4b86-8b51-113bf339ceff]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fLYXDxHG'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4355f0-fb93-4532-b165-4d4461b4f892]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa86a4-f142-4cf1-a7f3-2a1b46f8d5d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:22:18 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:22:18 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:22:18 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:22:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:22:18 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:22:18 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:22:18 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:22:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:22:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] HCTL ('37', '0', '0', 0) found on session 12 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d334f-7d67-4051-82a8-ffa064b5249d]: (4, ('0 0 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching for a device in session 12 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.218s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '26435323232346538', 'path': '/dev/sdf'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323232346538', 'path': '/dev/sdf'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759705474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759705474',id=14,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-hevbummp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:20:46Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=4eb07fb7-1056-44f7-a6df-c2d42c64c393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "vif_mac": "fa:16:3e:ba:da:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "vif_mac": "fa:16:3e:ba:da:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:22:19 user nova-compute[72441]:   <uuid>4eb07fb7-1056-44f7-a6df-c2d42c64c393</uuid>
Aug 09 19:22:19 user nova-compute[72441]:   <name>instance-0000000e</name>
Aug 09 19:22:19 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:22:19 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:22:19 user nova-compute[72441]:   <metadata>
Aug 09 19:22:19 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:22:19 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:22:19 user nova-compute[72441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1759705474</nova:name>
Aug 09 19:22:19 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:22:18</nova:creationTime>
Aug 09 19:22:19 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:22:19 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:22:19 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:22:19 user nova-compute[72441]:       <nova:owner>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:user uuid="554ea2267ce94d618fbd7ef211cb7b51">tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member</nova:user>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:project uuid="e0d7a9e68495428292b9417ee4b234ad">tempest-ServerBootFromVolumeStableRescueTest-1993502489</nova:project>
Aug 09 19:22:19 user nova-compute[72441]:       </nova:owner>
Aug 09 19:22:19 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:22:19 user nova-compute[72441]:       <nova:ports>
Aug 09 19:22:19 user nova-compute[72441]:         <nova:port uuid="281c4b39-0bff-4f2c-b5ef-80aadcb0a22e">
Aug 09 19:22:19 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:22:19 user nova-compute[72441]:         </nova:port>
Aug 09 19:22:19 user nova-compute[72441]:       </nova:ports>
Aug 09 19:22:19 user nova-compute[72441]:     </nova:instance>
Aug 09 19:22:19 user nova-compute[72441]:   </metadata>
Aug 09 19:22:19 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:22:19 user nova-compute[72441]:     <system>
Aug 09 19:22:19 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:22:19 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:22:19 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:22:19 user nova-compute[72441]:       <entry name="serial">4eb07fb7-1056-44f7-a6df-c2d42c64c393</entry>
Aug 09 19:22:19 user nova-compute[72441]:       <entry name="uuid">4eb07fb7-1056-44f7-a6df-c2d42c64c393</entry>
Aug 09 19:22:19 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:22:19 user nova-compute[72441]:     </system>
Aug 09 19:22:19 user nova-compute[72441]:   </sysinfo>
Aug 09 19:22:19 user nova-compute[72441]:   <os>
Aug 09 19:22:19 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:22:19 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:22:19 user nova-compute[72441]:   </os>
Aug 09 19:22:19 user nova-compute[72441]:   <features>
Aug 09 19:22:19 user nova-compute[72441]:     <acpi/>
Aug 09 19:22:19 user nova-compute[72441]:     <apic/>
Aug 09 19:22:19 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:22:19 user nova-compute[72441]:   </features>
Aug 09 19:22:19 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:22:19 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:22:19 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:22:19 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:22:19 user nova-compute[72441]:   </clock>
Aug 09 19:22:19 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:22:19 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:22:19 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:22:19 user nova-compute[72441]:   </cpu>
Aug 09 19:22:19 user nova-compute[72441]:   <devices>
Aug 09 19:22:19 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:22:19 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:22:19 user nova-compute[72441]:       <source dev="/dev/sdf"/>
Aug 09 19:22:19 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:22:19 user nova-compute[72441]:       <serial>cbbff22c-817c-48f7-b3d6-0a0daf1fa632</serial>
Aug 09 19:22:19 user nova-compute[72441]:     </disk>
Aug 09 19:22:19 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:22:19 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:22:19 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue"/>
Aug 09 19:22:19 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:22:19 user nova-compute[72441]:       <boot order="1"/>
Aug 09 19:22:19 user nova-compute[72441]:     </disk>
Aug 09 19:22:19 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:22:19 user nova-compute[72441]:       <mac address="fa:16:3e:ba:da:91"/>
Aug 09 19:22:19 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:19 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:22:19 user nova-compute[72441]:       <target dev="tap281c4b39-0b"/>
Aug 09 19:22:19 user nova-compute[72441]:     </interface>
Aug 09 19:22:19 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:22:19 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/console.log" append="off"/>
Aug 09 19:22:19 user nova-compute[72441]:     </serial>
Aug 09 19:22:19 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:22:19 user nova-compute[72441]:     <video>
Aug 09 19:22:19 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:19 user nova-compute[72441]:     </video>
Aug 09 19:22:19 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:22:19 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:22:19 user nova-compute[72441]:     </rng>
Aug 09 19:22:19 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:22:19 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:22:19 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:22:19 user nova-compute[72441]:     </memballoon>
Aug 09 19:22:19 user nova-compute[72441]:   </devices>
Aug 09 19:22:19 user nova-compute[72441]: </domain>
Aug 09 19:22:19 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:22:19 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance destroyed successfully.
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:22:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No VIF found with MAC fa:16:3e:ba:da:91, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:22:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-be9ecbd1-4d0f-4425-a2e5-82aa5b7d2b63 req-7025a33f-ba2a-43f4-a107-0ea9bef46e81 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be9ecbd1-4d0f-4425-a2e5-82aa5b7d2b63 req-7025a33f-ba2a-43f4-a107-0ea9bef46e81 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be9ecbd1-4d0f-4425-a2e5-82aa5b7d2b63 req-7025a33f-ba2a-43f4-a107-0ea9bef46e81 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be9ecbd1-4d0f-4425-a2e5-82aa5b7d2b63 req-7025a33f-ba2a-43f4-a107-0ea9bef46e81 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-be9ecbd1-4d0f-4425-a2e5-82aa5b7d2b63 req-7025a33f-ba2a-43f4-a107-0ea9bef46e81 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:22 user nova-compute[72441]: WARNING nova.compute.manager [req-be9ecbd1-4d0f-4425-a2e5-82aa5b7d2b63 req-7025a33f-ba2a-43f4-a107-0ea9bef46e81 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state active and task_state rescuing.
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 4eb07fb7-1056-44f7-a6df-c2d42c64c393 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608943.1483874, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:23 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Resumed (Lifecycle Event)
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5f506b7d-3924-425b-8dab-f80629591aa9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:23 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608943.1488583, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:23 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Started (Lifecycle Event)
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:22:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab480b84-fffb-419c-a0fd-a3ad11cfdca8 req-921297ec-9eb9-4474-beaa-b93b65190567 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab480b84-fffb-419c-a0fd-a3ad11cfdca8 req-921297ec-9eb9-4474-beaa-b93b65190567 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab480b84-fffb-419c-a0fd-a3ad11cfdca8 req-921297ec-9eb9-4474-beaa-b93b65190567 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab480b84-fffb-419c-a0fd-a3ad11cfdca8 req-921297ec-9eb9-4474-beaa-b93b65190567 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab480b84-fffb-419c-a0fd-a3ad11cfdca8 req-921297ec-9eb9-4474-beaa-b93b65190567 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:24 user nova-compute[72441]: WARNING nova.compute.manager [req-ab480b84-fffb-419c-a0fd-a3ad11cfdca8 req-921297ec-9eb9-4474-beaa-b93b65190567 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state rescued and task_state None.
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:22:25 user nova-compute[72441]: INFO nova.compute.claims [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Claim successful on node user
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=25.408889770507812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:26 user nova-compute[72441]: INFO nova.compute.manager [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Detaching volume 983c7e86-a831-43f2-9473-2b61f56dd109
Aug 09 19:22:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.498s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.356s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:22:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:22:26 user nova-compute[72441]: INFO nova.virt.block_device [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Attempting to driver detach volume 983c7e86-a831-43f2-9473-2b61f56dd109 from mountpoint /dev/vdb
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Attempting to detach device vdb from instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:22:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:22:26 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:22:26 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:22:26 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:22:26 user nova-compute[72441]:   <serial>983c7e86-a831-43f2-9473-2b61f56dd109</serial>
Aug 09 19:22:26 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:22:26 user nova-compute[72441]: </disk>
Aug 09 19:22:26 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bad8b180-4469-4439-8df9-188ec39a1314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33896e33-6002-4305-9928-e958ec21155b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 84bdfb26-f639-4431-821c-dcdbe7a55eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6af57e2e-ad59-4567-956f-1547e9b97abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:22:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully detached device vdb from instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d from the persistent domain config.
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:22:27 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:22:27 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:22:27 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:22:27 user nova-compute[72441]:   <serial>983c7e86-a831-43f2-9473-2b61f56dd109</serial>
Aug 09 19:22:27 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:22:27 user nova-compute[72441]: </disk>
Aug 09 19:22:27 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:22:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Creating image(s)
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "/opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "/opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "/opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.policy [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f8d8970681147f0b260536a1ae85cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64589b70774f168e322237f4ba8f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk 1073741824" returned: 0 in 0.054s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691608947.4869463, 32d57777-50e6-4fcb-b4e1-94b154e69f4d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully detached device vdb from instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d from the live domain config.
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfsyeFvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:22:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb483f3-22f1-4212-8693-a54d871a588a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.792s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bef693-00e8-4494-8842-b77d18675c92]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:22:27 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:22:27 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:22:27 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:22:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:22:27 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:22:27 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:22:27 user nova-compute[72441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 (non-flash)
Aug 09 19:22:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905b6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e185562-ce08-4124-a54b-9c6a90e6cd68]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b266d8bb-5fde-4a10-9097-a1f53d7bcccb]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8877677-6a14-4cd2-aa8a-9c8ee81151e5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Cannot resize image /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.objects.instance [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lazy-loading 'migration_context' on Instance uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Ensure instance console log exists: /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6938eb-0e5c-4d7c-9089-51498ecc31e7]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfaf8a9-35ba-4f6d-9d95-65b4d645a38b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbb524-2d32-45b2-bee5-9c06a163a8a3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260]
Aug 09 19:22:27 user nova-compute[72441]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109, portal: 172.16.0.220,3260] successful.
Aug 09 19:22:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983c7e86-a831-43f2-9473-2b61f56dd109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e16556c-87e3-4802-9872-15080265bfcf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== disconnect_volume: return (377ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:22:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6183c9-8724-41b1-b9d5-4829a5555fb8 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.057s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating instance_info_cache with network_info: [{"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-bad8b180-4469-4439-8df9-188ec39a1314" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:22:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:22:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Successfully created port: 7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Successfully updated port: 7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquired lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-changed-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Refreshing instance network info cache due to event network-changed-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:22:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] Acquiring lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updating instance_info_cache with network_info: [{"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Releasing lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Instance network_info: |[{"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] Acquired lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Refreshing network info cache for port 7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Start _get_guest_xml network_info=[{"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4662465',id=18,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkM6ow9DIPWJjnO/+aZhGd+lTj9TenNX+F8x18qbfUQn3f2x6+nfme32t+XtJ0fpyWe/woODCbBXPVev89fyHxC+REf2qjjVOSZySluAqtoNJVb5WA4VU0oCWLqYctFlg==',key_name='tempest-keypair-1838124240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec64589b70774f168e322237f4ba8f02',ramdisk_id='',reservation_id='r-3xo4nywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1787039980',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f8d8970681147f0b260536a1ae85cce',uuid=6af57e2e-ad59-4567-956f-1547e9b97abb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Converting VIF {"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.objects.instance [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lazy-loading 'pci_devices' on Instance uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:22:32 user nova-compute[72441]:   <uuid>6af57e2e-ad59-4567-956f-1547e9b97abb</uuid>
Aug 09 19:22:32 user nova-compute[72441]:   <name>instance-00000012</name>
Aug 09 19:22:32 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:22:32 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:22:32 user nova-compute[72441]:   <metadata>
Aug 09 19:22:32 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:22:32 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:22:32 user nova-compute[72441]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566</nova:name>
Aug 09 19:22:32 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:22:32</nova:creationTime>
Aug 09 19:22:32 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:22:32 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:22:32 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:22:32 user nova-compute[72441]:       <nova:owner>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:user uuid="8f8d8970681147f0b260536a1ae85cce">tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member</nova:user>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:project uuid="ec64589b70774f168e322237f4ba8f02">tempest-TestServerVolumeAttachScenarioOldVersion-1787039980</nova:project>
Aug 09 19:22:32 user nova-compute[72441]:       </nova:owner>
Aug 09 19:22:32 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:22:32 user nova-compute[72441]:       <nova:ports>
Aug 09 19:22:32 user nova-compute[72441]:         <nova:port uuid="7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109">
Aug 09 19:22:32 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 19:22:32 user nova-compute[72441]:         </nova:port>
Aug 09 19:22:32 user nova-compute[72441]:       </nova:ports>
Aug 09 19:22:32 user nova-compute[72441]:     </nova:instance>
Aug 09 19:22:32 user nova-compute[72441]:   </metadata>
Aug 09 19:22:32 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:22:32 user nova-compute[72441]:     <system>
Aug 09 19:22:32 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:22:32 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:22:32 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:22:32 user nova-compute[72441]:       <entry name="serial">6af57e2e-ad59-4567-956f-1547e9b97abb</entry>
Aug 09 19:22:32 user nova-compute[72441]:       <entry name="uuid">6af57e2e-ad59-4567-956f-1547e9b97abb</entry>
Aug 09 19:22:32 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:22:32 user nova-compute[72441]:     </system>
Aug 09 19:22:32 user nova-compute[72441]:   </sysinfo>
Aug 09 19:22:32 user nova-compute[72441]:   <os>
Aug 09 19:22:32 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:22:32 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:22:32 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:22:32 user nova-compute[72441]:   </os>
Aug 09 19:22:32 user nova-compute[72441]:   <features>
Aug 09 19:22:32 user nova-compute[72441]:     <acpi/>
Aug 09 19:22:32 user nova-compute[72441]:     <apic/>
Aug 09 19:22:32 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:22:32 user nova-compute[72441]:   </features>
Aug 09 19:22:32 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:22:32 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:22:32 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:22:32 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:22:32 user nova-compute[72441]:   </clock>
Aug 09 19:22:32 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:22:32 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:22:32 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:22:32 user nova-compute[72441]:   </cpu>
Aug 09 19:22:32 user nova-compute[72441]:   <devices>
Aug 09 19:22:32 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:22:32 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:22:32 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk"/>
Aug 09 19:22:32 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:22:32 user nova-compute[72441]:     </disk>
Aug 09 19:22:32 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:22:32 user nova-compute[72441]:       <mac address="fa:16:3e:ae:13:ed"/>
Aug 09 19:22:32 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:32 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:22:32 user nova-compute[72441]:       <target dev="tap7ceddd5e-f7"/>
Aug 09 19:22:32 user nova-compute[72441]:     </interface>
Aug 09 19:22:32 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:22:32 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/console.log" append="off"/>
Aug 09 19:22:32 user nova-compute[72441]:     </serial>
Aug 09 19:22:32 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:22:32 user nova-compute[72441]:     <video>
Aug 09 19:22:32 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:32 user nova-compute[72441]:     </video>
Aug 09 19:22:32 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:22:32 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:22:32 user nova-compute[72441]:     </rng>
Aug 09 19:22:32 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:22:32 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:22:32 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:22:32 user nova-compute[72441]:     </memballoon>
Aug 09 19:22:32 user nova-compute[72441]:   </devices>
Aug 09 19:22:32 user nova-compute[72441]: </domain>
Aug 09 19:22:32 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4662465',id=18,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkM6ow9DIPWJjnO/+aZhGd+lTj9TenNX+F8x18qbfUQn3f2x6+nfme32t+XtJ0fpyWe/woODCbBXPVev89fyHxC+REf2qjjVOSZySluAqtoNJVb5WA4VU0oCWLqYctFlg==',key_name='tempest-keypair-1838124240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec64589b70774f168e322237f4ba8f02',ramdisk_id='',reservation_id='r-3xo4nywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1787039980',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f8d8970681147f0b260536a1ae85cce',uuid=6af57e2e-ad59-4567-956f-1547e9b97abb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Converting VIF {"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG os_vif [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ceddd5e-f7, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ceddd5e-f7, col_values=(('external_ids', {'iface-id': '7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:13:ed', 'vm-uuid': '6af57e2e-ad59-4567-956f-1547e9b97abb'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:32 user nova-compute[72441]: INFO os_vif [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7')
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] No VIF found with MAC fa:16:3e:ae:13:ed, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updated VIF entry in instance network info cache for port 7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updating instance_info_cache with network_info: [{"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-82d48bec-ad07-4375-a634-84016bca14ad req-7d2021f3-3cad-4853-bda1-6ee9b7becc5f service nova] Releasing lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing instance network info cache due to event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-0aeaa1ae-d80f-4f3f-8bc5-29a9b3826479 req-1c306d8e-fc1e-47a3-ba36-5027acbefa84 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0aeaa1ae-d80f-4f3f-8bc5-29a9b3826479 req-1c306d8e-fc1e-47a3-ba36-5027acbefa84 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0aeaa1ae-d80f-4f3f-8bc5-29a9b3826479 req-1c306d8e-fc1e-47a3-ba36-5027acbefa84 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0aeaa1ae-d80f-4f3f-8bc5-29a9b3826479 req-1c306d8e-fc1e-47a3-ba36-5027acbefa84 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-0aeaa1ae-d80f-4f3f-8bc5-29a9b3826479 req-1c306d8e-fc1e-47a3-ba36-5027acbefa84 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:34 user nova-compute[72441]: WARNING nova.compute.manager [req-0aeaa1ae-d80f-4f3f-8bc5-29a9b3826479 req-1c306d8e-fc1e-47a3-ba36-5027acbefa84 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received unexpected event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with vm_state building and task_state spawning.
Aug 09 19:22:34 user nova-compute[72441]: DEBUG nova.network.neutron [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updated VIF entry in instance network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG nova.network.neutron [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f8dab489-9be6-4d4b-8478-5b358368d760 req-ba816ea5-a5e2-4850-95a5-e331a0743d09 service nova] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608956.4250884, 6af57e2e-ad59-4567-956f-1547e9b97abb => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] VM Resumed (Lifecycle Event)
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Instance spawned successfully.
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608956.4267395, 6af57e2e-ad59-4567-956f-1547e9b97abb => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] VM Started (Lifecycle Event)
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Took 9.50 seconds to spawn the instance on the hypervisor.
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:36 user nova-compute[72441]: INFO nova.compute.manager [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Took 11.45 seconds to build instance.
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-89578899-570d-444a-89bd-b27651a39c82 req-e94b21be-0bef-4d06-820b-2d6da1c6af97 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89578899-570d-444a-89bd-b27651a39c82 req-e94b21be-0bef-4d06-820b-2d6da1c6af97 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89578899-570d-444a-89bd-b27651a39c82 req-e94b21be-0bef-4d06-820b-2d6da1c6af97 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89578899-570d-444a-89bd-b27651a39c82 req-e94b21be-0bef-4d06-820b-2d6da1c6af97 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-89578899-570d-444a-89bd-b27651a39c82 req-e94b21be-0bef-4d06-820b-2d6da1c6af97 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:36 user nova-compute[72441]: WARNING nova.compute.manager [req-89578899-570d-444a-89bd-b27651a39c82 req-e94b21be-0bef-4d06-820b-2d6da1c6af97 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received unexpected event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with vm_state active and task_state None.
Aug 09 19:22:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-31f4c3fc-e115-4b31-82c0-8077041f0226 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.579s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "222c489c-36ed-4210-9403-d98927c7f7fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:22:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:38 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:22:38 user nova-compute[72441]: INFO nova.compute.claims [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Claim successful on node user
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:22:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:22:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Creating image(s)
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "/opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "/opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "/opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG nova.policy [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95cede1cc2549dfb6c82d2baeaaf39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1c396deeca4c219140761e4bd8141d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.205s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:40 user nova-compute[72441]: INFO nova.compute.manager [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Shelving
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.167s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk 1073741824" returned: 0 in 0.070s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.208s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Cannot resize image /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lazy-loading 'migration_context' on Instance uuid 222c489c-36ed-4210-9403-d98927c7f7fe {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Ensure instance console log exists: /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-9d37e410-481e-4ab2-bdde-f783fdbb5bac req-e2f63354-c2fb-441b-bd35-0cb3b67eb402 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-unplugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9d37e410-481e-4ab2-bdde-f783fdbb5bac req-e2f63354-c2fb-441b-bd35-0cb3b67eb402 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9d37e410-481e-4ab2-bdde-f783fdbb5bac req-e2f63354-c2fb-441b-bd35-0cb3b67eb402 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9d37e410-481e-4ab2-bdde-f783fdbb5bac req-e2f63354-c2fb-441b-bd35-0cb3b67eb402 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-9d37e410-481e-4ab2-bdde-f783fdbb5bac req-e2f63354-c2fb-441b-bd35-0cb3b67eb402 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-unplugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:40 user nova-compute[72441]: WARNING nova.compute.manager [req-9d37e410-481e-4ab2-bdde-f783fdbb5bac req-e2f63354-c2fb-441b-bd35-0cb3b67eb402 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-unplugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state active and task_state shelving.
Aug 09 19:22:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance destroyed successfully.
Aug 09 19:22:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Beginning cold snapshot process
Aug 09 19:22:41 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:22:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk /opt/stack/data/nova/instances/snapshots/tmpsnqz992s/b0fe41d6e05e48a98e6dbc880a6fbc2d {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Successfully created port: 9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:22:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk /opt/stack/data/nova/instances/snapshots/tmpsnqz992s/b0fe41d6e05e48a98e6dbc880a6fbc2d" returned: 0 in 0.643s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:42 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Snapshot extracted, beginning image upload
Aug 09 19:22:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-d2c0bfd5-5e84-4d71-87bd-74718fb8afed req-d5c1c666-c6c1-430a-aba0-54ade65c0a5b service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d2c0bfd5-5e84-4d71-87bd-74718fb8afed req-d5c1c666-c6c1-430a-aba0-54ade65c0a5b service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d2c0bfd5-5e84-4d71-87bd-74718fb8afed req-d5c1c666-c6c1-430a-aba0-54ade65c0a5b service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d2c0bfd5-5e84-4d71-87bd-74718fb8afed req-d5c1c666-c6c1-430a-aba0-54ade65c0a5b service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-d2c0bfd5-5e84-4d71-87bd-74718fb8afed req-d5c1c666-c6c1-430a-aba0-54ade65c0a5b service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:42 user nova-compute[72441]: WARNING nova.compute.manager [req-d2c0bfd5-5e84-4d71-87bd-74718fb8afed req-d5c1c666-c6c1-430a-aba0-54ade65c0a5b service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Successfully updated port: 9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "refresh_cache-222c489c-36ed-4210-9403-d98927c7f7fe" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquired lock "refresh_cache-222c489c-36ed-4210-9403-d98927c7f7fe" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-changed-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Refreshing instance network info cache due to event network-changed-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] Acquiring lock "refresh_cache-222c489c-36ed-4210-9403-d98927c7f7fe" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Updating instance_info_cache with network_info: [{"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Releasing lock "refresh_cache-222c489c-36ed-4210-9403-d98927c7f7fe" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Instance network_info: |[{"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] Acquired lock "refresh_cache-222c489c-36ed-4210-9403-d98927c7f7fe" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.neutron [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Refreshing network info cache for port 9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Start _get_guest_xml network_info=[{"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:22:43 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:43 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2123769625',display_name='tempest-VolumesActionsTest-instance-2123769625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2123769625',id=19,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1c396deeca4c219140761e4bd8141d',ramdisk_id='',reservation_id='r-4g76qem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-57443595',owner_user_name='tempest-VolumesActionsTest-57443595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:39Z,user_data=None,user_id='e95cede1cc2549dfb6c82d2baeaaf39a',uuid=222c489c-36ed-4210-9403-d98927c7f7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converting VIF {"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lazy-loading 'pci_devices' on Instance uuid 222c489c-36ed-4210-9403-d98927c7f7fe {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:22:43 user nova-compute[72441]:   <uuid>222c489c-36ed-4210-9403-d98927c7f7fe</uuid>
Aug 09 19:22:43 user nova-compute[72441]:   <name>instance-00000013</name>
Aug 09 19:22:43 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:22:43 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:22:43 user nova-compute[72441]:   <metadata>
Aug 09 19:22:43 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:22:43 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:22:43 user nova-compute[72441]:       <nova:name>tempest-VolumesActionsTest-instance-2123769625</nova:name>
Aug 09 19:22:43 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:22:43</nova:creationTime>
Aug 09 19:22:43 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:22:43 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:22:43 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:22:43 user nova-compute[72441]:       <nova:owner>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:user uuid="e95cede1cc2549dfb6c82d2baeaaf39a">tempest-VolumesActionsTest-57443595-project-member</nova:user>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:project uuid="cd1c396deeca4c219140761e4bd8141d">tempest-VolumesActionsTest-57443595</nova:project>
Aug 09 19:22:43 user nova-compute[72441]:       </nova:owner>
Aug 09 19:22:43 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:22:43 user nova-compute[72441]:       <nova:ports>
Aug 09 19:22:43 user nova-compute[72441]:         <nova:port uuid="9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103">
Aug 09 19:22:43 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:22:43 user nova-compute[72441]:         </nova:port>
Aug 09 19:22:43 user nova-compute[72441]:       </nova:ports>
Aug 09 19:22:43 user nova-compute[72441]:     </nova:instance>
Aug 09 19:22:43 user nova-compute[72441]:   </metadata>
Aug 09 19:22:43 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:22:43 user nova-compute[72441]:     <system>
Aug 09 19:22:43 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:22:43 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:22:43 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:22:43 user nova-compute[72441]:       <entry name="serial">222c489c-36ed-4210-9403-d98927c7f7fe</entry>
Aug 09 19:22:43 user nova-compute[72441]:       <entry name="uuid">222c489c-36ed-4210-9403-d98927c7f7fe</entry>
Aug 09 19:22:43 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:22:43 user nova-compute[72441]:     </system>
Aug 09 19:22:43 user nova-compute[72441]:   </sysinfo>
Aug 09 19:22:43 user nova-compute[72441]:   <os>
Aug 09 19:22:43 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:22:43 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:22:43 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:22:43 user nova-compute[72441]:   </os>
Aug 09 19:22:43 user nova-compute[72441]:   <features>
Aug 09 19:22:43 user nova-compute[72441]:     <acpi/>
Aug 09 19:22:43 user nova-compute[72441]:     <apic/>
Aug 09 19:22:43 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:22:43 user nova-compute[72441]:   </features>
Aug 09 19:22:43 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:22:43 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:22:43 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:22:43 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:22:43 user nova-compute[72441]:   </clock>
Aug 09 19:22:43 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:22:43 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:22:43 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:22:43 user nova-compute[72441]:   </cpu>
Aug 09 19:22:43 user nova-compute[72441]:   <devices>
Aug 09 19:22:43 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:22:43 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:22:43 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk"/>
Aug 09 19:22:43 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:22:43 user nova-compute[72441]:     </disk>
Aug 09 19:22:43 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:22:43 user nova-compute[72441]:       <mac address="fa:16:3e:83:8c:3d"/>
Aug 09 19:22:43 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:43 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:22:43 user nova-compute[72441]:       <target dev="tap9c4cb1a4-26"/>
Aug 09 19:22:43 user nova-compute[72441]:     </interface>
Aug 09 19:22:43 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:22:43 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/console.log" append="off"/>
Aug 09 19:22:43 user nova-compute[72441]:     </serial>
Aug 09 19:22:43 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:22:43 user nova-compute[72441]:     <video>
Aug 09 19:22:43 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:43 user nova-compute[72441]:     </video>
Aug 09 19:22:43 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:22:43 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:22:43 user nova-compute[72441]:     </rng>
Aug 09 19:22:43 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:22:43 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:22:43 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:22:43 user nova-compute[72441]:     </memballoon>
Aug 09 19:22:43 user nova-compute[72441]:   </devices>
Aug 09 19:22:43 user nova-compute[72441]: </domain>
Aug 09 19:22:43 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2123769625',display_name='tempest-VolumesActionsTest-instance-2123769625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2123769625',id=19,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1c396deeca4c219140761e4bd8141d',ramdisk_id='',reservation_id='r-4g76qem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-57443595',owner_user_name='tempest-VolumesActionsTest-57443595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:39Z,user_data=None,user_id='e95cede1cc2549dfb6c82d2baeaaf39a',uuid=222c489c-36ed-4210-9403-d98927c7f7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converting VIF {"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG os_vif [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c4cb1a4-26, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c4cb1a4-26, col_values=(('external_ids', {'iface-id': '9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:8c:3d', 'vm-uuid': '222c489c-36ed-4210-9403-d98927c7f7fe'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:43 user nova-compute[72441]: INFO os_vif [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26')
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:22:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] No VIF found with MAC fa:16:3e:83:8c:3d, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:22:44 user nova-compute[72441]: DEBUG nova.network.neutron [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Updated VIF entry in instance network info cache for port 9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:22:44 user nova-compute[72441]: DEBUG nova.network.neutron [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Updating instance_info_cache with network_info: [{"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ee0550f8-809a-45d6-bca3-2fa494802a71 req-eaff0104-6c0d-4e4a-b5b2-fd8bdc559158 service nova] Releasing lock "refresh_cache-222c489c-36ed-4210-9403-d98927c7f7fe" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:44 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Snapshot image upload complete
Aug 09 19:22:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:45 user nova-compute[72441]: INFO nova.compute.manager [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Shelve offloading
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance destroyed successfully.
Aug 09 19:22:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG nova.network.neutron [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-1301f844-f253-47f8-9e6b-7a9bee36211e req-e6ec4c37-74dc-496a-a602-75d3c951d2b3 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1301f844-f253-47f8-9e6b-7a9bee36211e req-e6ec4c37-74dc-496a-a602-75d3c951d2b3 service nova] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1301f844-f253-47f8-9e6b-7a9bee36211e req-e6ec4c37-74dc-496a-a602-75d3c951d2b3 service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1301f844-f253-47f8-9e6b-7a9bee36211e req-e6ec4c37-74dc-496a-a602-75d3c951d2b3 service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-1301f844-f253-47f8-9e6b-7a9bee36211e req-e6ec4c37-74dc-496a-a602-75d3c951d2b3 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] No waiting events found dispatching network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:45 user nova-compute[72441]: WARNING nova.compute.manager [req-1301f844-f253-47f8-9e6b-7a9bee36211e req-e6ec4c37-74dc-496a-a602-75d3c951d2b3 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received unexpected event network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 for instance with vm_state building and task_state spawning.
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.compute.claims [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Claim successful on node user
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance destroyed successfully.
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.objects.instance [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'resources' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1532187531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1532187531',id=15,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyxkh/V7vIgiMnU5QRCpAzARoVccI/y1XmvHfLb2SGY89lpnKEea3r9+ah0UaGRCubwtIL5m+b9uqo633s5bE0ycaZIo0ehTjBYDEAzcUysqkf66kOCodYMVbH11gJuVg==',key_name='tempest-keypair-399743535',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-yp85lf82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member',shelved_at='2023-08-09T19:22:44.999759',shelved_host='user',shelved_image_id='4d61264f-95a2-4536-8edf-68f362c48bc3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=9993e22d-c00a-497a-bb28-500abdc8a2f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG os_vif [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4549fab1-2c, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:47 user nova-compute[72441]: INFO os_vif [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c')
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Deleting instance files /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3_del
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Deletion of /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3_del complete
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608967.5161526, 222c489c-36ed-4210-9403-d98927c7f7fe => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] VM Resumed (Lifecycle Event)
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Instance spawned successfully.
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Deleted allocations for instance 9993e22d-c00a-497a-bb28-500abdc8a2f3
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Took 7.95 seconds to spawn the instance on the hypervisor.
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608967.5208538, 222c489c-36ed-4210-9403-d98927c7f7fe => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] VM Started (Lifecycle Event)
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.network.neutron [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.objects.instance [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'numa_topology' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.compute.manager [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Took 9.14 seconds to build instance.
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] No waiting events found dispatching network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:47 user nova-compute[72441]: WARNING nova.compute.manager [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received unexpected event network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 for instance with vm_state active and task_state None.
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing instance network info cache due to event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.network.neutron [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3eba80c8-5af8-481a-b6ca-e5abd5a2c371 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "222c489c-36ed-4210-9403-d98927c7f7fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.275s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.policy [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bdbd35f8a0d4f3297acb453e3109176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcefc0bffad468b82ae957092668524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:22:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Creating image(s)
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.195s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk 1073741824" returned: 0 in 0.080s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.765s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.026s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:22:48 user nova-compute[72441]: INFO nova.compute.claims [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Claim successful on node user
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-be6d0bd2-0b0d-441b-94d5-38e90e828ca5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.587s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.network.neutron [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Successfully created port: 9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Cannot resize image /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'migration_context' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Ensure instance console log exists: /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:22:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.policy [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bdbd35f8a0d4f3297acb453e3109176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcefc0bffad468b82ae957092668524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:22:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Creating image(s)
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Successfully updated port: 9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.network.neutron [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updated VIF entry in instance network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.network.neutron [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4549fab1-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-892dccff-27fd-41ee-895c-8f692c012219 req-ee9e8bd8-bc1f-4cba-a000-c07633343082 service nova] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.196s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-changed-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Refreshing instance network info cache due to event network-changed-9c11f350-193b-4573-828c-1c72e7effd21. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk 1073741824" returned: 0 in 0.058s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Successfully created port: 18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Cannot resize image /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'migration_context' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Ensure instance console log exists: /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance network_info: |[{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.neutron [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Refreshing network info cache for port 9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Start _get_guest_xml network_info=[{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:22:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-528314346',display_name='tempest-ServerRescueNegativeTestJSON-server-528314346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-528314346',id=20,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-p9iy01kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:48Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=e30cf305-f264-4aab-a4cf-f555a57e8db3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'pci_devices' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:22:50 user nova-compute[72441]:   <uuid>e30cf305-f264-4aab-a4cf-f555a57e8db3</uuid>
Aug 09 19:22:50 user nova-compute[72441]:   <name>instance-00000014</name>
Aug 09 19:22:50 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:22:50 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:22:50 user nova-compute[72441]:   <metadata>
Aug 09 19:22:50 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:22:50 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:22:50 user nova-compute[72441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-528314346</nova:name>
Aug 09 19:22:50 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:22:50</nova:creationTime>
Aug 09 19:22:50 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:22:50 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:22:50 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:22:50 user nova-compute[72441]:       <nova:owner>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:user uuid="3bdbd35f8a0d4f3297acb453e3109176">tempest-ServerRescueNegativeTestJSON-1340711293-project-member</nova:user>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:project uuid="6dcefc0bffad468b82ae957092668524">tempest-ServerRescueNegativeTestJSON-1340711293</nova:project>
Aug 09 19:22:50 user nova-compute[72441]:       </nova:owner>
Aug 09 19:22:50 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:22:50 user nova-compute[72441]:       <nova:ports>
Aug 09 19:22:50 user nova-compute[72441]:         <nova:port uuid="9c11f350-193b-4573-828c-1c72e7effd21">
Aug 09 19:22:50 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:22:50 user nova-compute[72441]:         </nova:port>
Aug 09 19:22:50 user nova-compute[72441]:       </nova:ports>
Aug 09 19:22:50 user nova-compute[72441]:     </nova:instance>
Aug 09 19:22:50 user nova-compute[72441]:   </metadata>
Aug 09 19:22:50 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:22:50 user nova-compute[72441]:     <system>
Aug 09 19:22:50 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:22:50 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:22:50 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:22:50 user nova-compute[72441]:       <entry name="serial">e30cf305-f264-4aab-a4cf-f555a57e8db3</entry>
Aug 09 19:22:50 user nova-compute[72441]:       <entry name="uuid">e30cf305-f264-4aab-a4cf-f555a57e8db3</entry>
Aug 09 19:22:50 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:22:50 user nova-compute[72441]:     </system>
Aug 09 19:22:50 user nova-compute[72441]:   </sysinfo>
Aug 09 19:22:50 user nova-compute[72441]:   <os>
Aug 09 19:22:50 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:22:50 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:22:50 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:22:50 user nova-compute[72441]:   </os>
Aug 09 19:22:50 user nova-compute[72441]:   <features>
Aug 09 19:22:50 user nova-compute[72441]:     <acpi/>
Aug 09 19:22:50 user nova-compute[72441]:     <apic/>
Aug 09 19:22:50 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:22:50 user nova-compute[72441]:   </features>
Aug 09 19:22:50 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:22:50 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:22:50 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:22:50 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:22:50 user nova-compute[72441]:   </clock>
Aug 09 19:22:50 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:22:50 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:22:50 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:22:50 user nova-compute[72441]:   </cpu>
Aug 09 19:22:50 user nova-compute[72441]:   <devices>
Aug 09 19:22:50 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:22:50 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:22:50 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk"/>
Aug 09 19:22:50 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:22:50 user nova-compute[72441]:     </disk>
Aug 09 19:22:50 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:22:50 user nova-compute[72441]:       <mac address="fa:16:3e:e7:08:91"/>
Aug 09 19:22:50 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:50 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:22:50 user nova-compute[72441]:       <target dev="tap9c11f350-19"/>
Aug 09 19:22:50 user nova-compute[72441]:     </interface>
Aug 09 19:22:50 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:22:50 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/console.log" append="off"/>
Aug 09 19:22:50 user nova-compute[72441]:     </serial>
Aug 09 19:22:50 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:22:50 user nova-compute[72441]:     <video>
Aug 09 19:22:50 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:50 user nova-compute[72441]:     </video>
Aug 09 19:22:50 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:22:50 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:22:50 user nova-compute[72441]:     </rng>
Aug 09 19:22:50 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:22:50 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:22:50 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:22:50 user nova-compute[72441]:     </memballoon>
Aug 09 19:22:50 user nova-compute[72441]:   </devices>
Aug 09 19:22:50 user nova-compute[72441]: </domain>
Aug 09 19:22:50 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-528314346',display_name='tempest-ServerRescueNegativeTestJSON-server-528314346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-528314346',id=20,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-p9iy01kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:48Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=e30cf305-f264-4aab-a4cf-f555a57e8db3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG os_vif [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c11f350-19, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c11f350-19, col_values=(('external_ids', {'iface-id': '9c11f350-193b-4573-828c-1c72e7effd21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:08:91', 'vm-uuid': 'e30cf305-f264-4aab-a4cf-f555a57e8db3'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:50 user nova-compute[72441]: INFO os_vif [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19')
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:22:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:e7:08:91, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.network.neutron [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updated VIF entry in instance network info cache for port 9c11f350-193b-4573-828c-1c72e7effd21. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.network.neutron [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-30c480ed-79fe-4ac0-95c8-d2e22acc1368 req-e540fdb5-3343-465e-87c2-b19fdbbdb1f7 service nova] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Successfully updated port: 18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-changed-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Refreshing instance network info cache due to event network-changed-18515de4-95d3-463f-a469-61abac987981. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] Acquiring lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:22:51 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance network_info: |[{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] Acquired lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.neutron [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Refreshing network info cache for port 18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Start _get_guest_xml network_info=[{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:22:52 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:52 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2124327960',display_name='tempest-ServerRescueNegativeTestJSON-server-2124327960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2124327960',id=21,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-k02t4a5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:49Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=d643ae7c-ca03-4921-b6d2-66433a539cde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'pci_devices' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:22:52 user nova-compute[72441]:   <uuid>d643ae7c-ca03-4921-b6d2-66433a539cde</uuid>
Aug 09 19:22:52 user nova-compute[72441]:   <name>instance-00000015</name>
Aug 09 19:22:52 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:22:52 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:22:52 user nova-compute[72441]:   <metadata>
Aug 09 19:22:52 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:22:52 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:22:52 user nova-compute[72441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2124327960</nova:name>
Aug 09 19:22:52 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:22:52</nova:creationTime>
Aug 09 19:22:52 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:22:52 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:22:52 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:22:52 user nova-compute[72441]:       <nova:owner>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:user uuid="3bdbd35f8a0d4f3297acb453e3109176">tempest-ServerRescueNegativeTestJSON-1340711293-project-member</nova:user>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:project uuid="6dcefc0bffad468b82ae957092668524">tempest-ServerRescueNegativeTestJSON-1340711293</nova:project>
Aug 09 19:22:52 user nova-compute[72441]:       </nova:owner>
Aug 09 19:22:52 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:22:52 user nova-compute[72441]:       <nova:ports>
Aug 09 19:22:52 user nova-compute[72441]:         <nova:port uuid="18515de4-95d3-463f-a469-61abac987981">
Aug 09 19:22:52 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 19:22:52 user nova-compute[72441]:         </nova:port>
Aug 09 19:22:52 user nova-compute[72441]:       </nova:ports>
Aug 09 19:22:52 user nova-compute[72441]:     </nova:instance>
Aug 09 19:22:52 user nova-compute[72441]:   </metadata>
Aug 09 19:22:52 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:22:52 user nova-compute[72441]:     <system>
Aug 09 19:22:52 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:22:52 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:22:52 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:22:52 user nova-compute[72441]:       <entry name="serial">d643ae7c-ca03-4921-b6d2-66433a539cde</entry>
Aug 09 19:22:52 user nova-compute[72441]:       <entry name="uuid">d643ae7c-ca03-4921-b6d2-66433a539cde</entry>
Aug 09 19:22:52 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:22:52 user nova-compute[72441]:     </system>
Aug 09 19:22:52 user nova-compute[72441]:   </sysinfo>
Aug 09 19:22:52 user nova-compute[72441]:   <os>
Aug 09 19:22:52 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:22:52 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:22:52 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:22:52 user nova-compute[72441]:   </os>
Aug 09 19:22:52 user nova-compute[72441]:   <features>
Aug 09 19:22:52 user nova-compute[72441]:     <acpi/>
Aug 09 19:22:52 user nova-compute[72441]:     <apic/>
Aug 09 19:22:52 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:22:52 user nova-compute[72441]:   </features>
Aug 09 19:22:52 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:22:52 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:22:52 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:22:52 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:22:52 user nova-compute[72441]:   </clock>
Aug 09 19:22:52 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:22:52 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:22:52 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:22:52 user nova-compute[72441]:   </cpu>
Aug 09 19:22:52 user nova-compute[72441]:   <devices>
Aug 09 19:22:52 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:22:52 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:22:52 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk"/>
Aug 09 19:22:52 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:22:52 user nova-compute[72441]:     </disk>
Aug 09 19:22:52 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:22:52 user nova-compute[72441]:       <mac address="fa:16:3e:48:0c:cb"/>
Aug 09 19:22:52 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:52 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:22:52 user nova-compute[72441]:       <target dev="tap18515de4-95"/>
Aug 09 19:22:52 user nova-compute[72441]:     </interface>
Aug 09 19:22:52 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:22:52 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/console.log" append="off"/>
Aug 09 19:22:52 user nova-compute[72441]:     </serial>
Aug 09 19:22:52 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:22:52 user nova-compute[72441]:     <video>
Aug 09 19:22:52 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:22:52 user nova-compute[72441]:     </video>
Aug 09 19:22:52 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:22:52 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:22:52 user nova-compute[72441]:     </rng>
Aug 09 19:22:52 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:22:52 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:22:52 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:22:52 user nova-compute[72441]:     </memballoon>
Aug 09 19:22:52 user nova-compute[72441]:   </devices>
Aug 09 19:22:52 user nova-compute[72441]: </domain>
Aug 09 19:22:52 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2124327960',display_name='tempest-ServerRescueNegativeTestJSON-server-2124327960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2124327960',id=21,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-k02t4a5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:49Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=d643ae7c-ca03-4921-b6d2-66433a539cde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG os_vif [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18515de4-95, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18515de4-95, col_values=(('external_ids', {'iface-id': '18515de4-95d3-463f-a469-61abac987981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0c:cb', 'vm-uuid': 'd643ae7c-ca03-4921-b6d2-66433a539cde'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: INFO os_vif [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95')
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:48:0c:cb, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-d5f4634b-d89a-4e72-9ab1-e546c7c6ae78 req-ecc24bf5-466b-46cf-9e90-53dfafd17aba service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d5f4634b-d89a-4e72-9ab1-e546c7c6ae78 req-ecc24bf5-466b-46cf-9e90-53dfafd17aba service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d5f4634b-d89a-4e72-9ab1-e546c7c6ae78 req-ecc24bf5-466b-46cf-9e90-53dfafd17aba service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d5f4634b-d89a-4e72-9ab1-e546c7c6ae78 req-ecc24bf5-466b-46cf-9e90-53dfafd17aba service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-d5f4634b-d89a-4e72-9ab1-e546c7c6ae78 req-ecc24bf5-466b-46cf-9e90-53dfafd17aba service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:52 user nova-compute[72441]: WARNING nova.compute.manager [req-d5f4634b-d89a-4e72-9ab1-e546c7c6ae78 req-ecc24bf5-466b-46cf-9e90-53dfafd17aba service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state building and task_state spawning.
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.neutron [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updated VIF entry in instance network info cache for port 18515de4-95d3-463f-a469-61abac987981. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG nova.network.neutron [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1e5f5e3d-a1c2-452b-833f-c0b7d577b660 req-134f9bfa-0c13-42b7-b158-85bfeed9b22e service nova] Releasing lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:22:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-afe4b1fc-134f-431f-968b-608cd937c382 req-90587e31-eb40-40a1-b89f-8ccc87f8f8c1 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-afe4b1fc-134f-431f-968b-608cd937c382 req-90587e31-eb40-40a1-b89f-8ccc87f8f8c1 service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-afe4b1fc-134f-431f-968b-608cd937c382 req-90587e31-eb40-40a1-b89f-8ccc87f8f8c1 service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-afe4b1fc-134f-431f-968b-608cd937c382 req-90587e31-eb40-40a1-b89f-8ccc87f8f8c1 service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-afe4b1fc-134f-431f-968b-608cd937c382 req-90587e31-eb40-40a1-b89f-8ccc87f8f8c1 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:54 user nova-compute[72441]: WARNING nova.compute.manager [req-afe4b1fc-134f-431f-968b-608cd937c382 req-90587e31-eb40-40a1-b89f-8ccc87f8f8c1 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state building and task_state spawning.
Aug 09 19:22:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-486f122d-3316-49d9-acf5-e1c08d5c8000 req-8386eecd-b88c-42d2-9c82-c708411cae85 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-486f122d-3316-49d9-acf5-e1c08d5c8000 req-8386eecd-b88c-42d2-9c82-c708411cae85 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-486f122d-3316-49d9-acf5-e1c08d5c8000 req-8386eecd-b88c-42d2-9c82-c708411cae85 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-486f122d-3316-49d9-acf5-e1c08d5c8000 req-8386eecd-b88c-42d2-9c82-c708411cae85 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-486f122d-3316-49d9-acf5-e1c08d5c8000 req-8386eecd-b88c-42d2-9c82-c708411cae85 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:54 user nova-compute[72441]: WARNING nova.compute.manager [req-486f122d-3316-49d9-acf5-e1c08d5c8000 req-8386eecd-b88c-42d2-9c82-c708411cae85 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state building and task_state spawning.
Aug 09 19:22:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:55 user nova-compute[72441]: INFO nova.compute.manager [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Terminating instance
Aug 09 19:22:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608961.0189812, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] VM Stopped (Lifecycle Event)
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5be76c2b-9ec3-435c-abde-b867634c3258 None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608976.1013505, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Resumed (Lifecycle Event)
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance spawned successfully.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608976.1021445, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Started (Lifecycle Event)
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Took 8.38 seconds to spawn the instance on the hypervisor.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Took 9.37 seconds to build instance.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-ed7021fd-43b1-40df-a2c6-1f54ee1aa443 req-7d18f710-3633-4189-a5d6-34710decfb86 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-vif-unplugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ed7021fd-43b1-40df-a2c6-1f54ee1aa443 req-7d18f710-3633-4189-a5d6-34710decfb86 service nova] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ed7021fd-43b1-40df-a2c6-1f54ee1aa443 req-7d18f710-3633-4189-a5d6-34710decfb86 service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ed7021fd-43b1-40df-a2c6-1f54ee1aa443 req-7d18f710-3633-4189-a5d6-34710decfb86 service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-ed7021fd-43b1-40df-a2c6-1f54ee1aa443 req-7d18f710-3633-4189-a5d6-34710decfb86 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] No waiting events found dispatching network-vif-unplugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-ed7021fd-43b1-40df-a2c6-1f54ee1aa443 req-7d18f710-3633-4189-a5d6-34710decfb86 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-vif-unplugged-fe657026-5782-4049-8e70-928ca87dd2e9 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-560b940b-37d5-4c27-9b2f-18a50412fa81 req-d47d31fa-a7cc-4bea-a90a-65f1c9eb205d service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-560b940b-37d5-4c27-9b2f-18a50412fa81 req-d47d31fa-a7cc-4bea-a90a-65f1c9eb205d service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-560b940b-37d5-4c27-9b2f-18a50412fa81 req-d47d31fa-a7cc-4bea-a90a-65f1c9eb205d service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-560b940b-37d5-4c27-9b2f-18a50412fa81 req-d47d31fa-a7cc-4bea-a90a-65f1c9eb205d service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-560b940b-37d5-4c27-9b2f-18a50412fa81 req-d47d31fa-a7cc-4bea-a90a-65f1c9eb205d service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:56 user nova-compute[72441]: WARNING nova.compute.manager [req-560b940b-37d5-4c27-9b2f-18a50412fa81 req-d47d31fa-a7cc-4bea-a90a-65f1c9eb205d service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state building and task_state spawning.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-597218d3-124b-4fd4-9f5f-308ce4ba3a6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.501s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Instance destroyed successfully.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.objects.instance [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'resources' on Instance uuid 84bdfb26-f639-4431-821c-dcdbe7a55eb7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1442761864',display_name='tempest-VolumesAdminNegativeTest-server-1442761864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1442761864',id=16,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f126de4ac5498786e47415c7e5ada4',ramdisk_id='',reservation_id='r-g08o3c7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1423875380',owner_user_name='tempest-VolumesAdminNegativeTest-1423875380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:21:04Z,user_data=None,user_id='e8c8b477c2d348c78e4ef1175a2b2c09',uuid=84bdfb26-f639-4431-821c-dcdbe7a55eb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converting VIF {"id": "fe657026-5782-4049-8e70-928ca87dd2e9", "address": "fa:16:3e:b5:4f:4a", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe657026-57", "ovs_interfaceid": "fe657026-5782-4049-8e70-928ca87dd2e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG os_vif [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe657026-57, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:22:56 user nova-compute[72441]: INFO os_vif [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fe657026-5782-4049-8e70-928ca87dd2e9,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe657026-57')
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Deleting instance files /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7_del
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Deletion of /opt/stack/data/nova/instances/84bdfb26-f639-4431-821c-dcdbe7a55eb7_del complete
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608976.8916955, d643ae7c-ca03-4921-b6d2-66433a539cde => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] VM Resumed (Lifecycle Event)
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance spawned successfully.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691608976.9019413, d643ae7c-ca03-4921-b6d2-66433a539cde => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:22:56 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] VM Started (Lifecycle Event)
Aug 09 19:22:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:22:57 user nova-compute[72441]: INFO nova.compute.manager [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 09 19:22:57 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:22:57 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:22:57 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:22:57 user nova-compute[72441]: INFO nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Took 7.42 seconds to spawn the instance on the hypervisor.
Aug 09 19:22:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:22:57 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:22:57 user nova-compute[72441]: INFO nova.compute.manager [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Took 8.70 seconds to build instance.
Aug 09 19:22:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7ea6cbfc-3db6-459e-b006-dd010f85601f tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.863s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:57 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:22:57 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Took 0.79 seconds to deallocate network for instance.
Aug 09 19:22:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:58 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Deleted allocations for instance 84bdfb26-f639-4431-821c-dcdbe7a55eb7
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] Acquiring lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] No waiting events found dispatching network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:22:58 user nova-compute[72441]: WARNING nova.compute.manager [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received unexpected event network-vif-plugged-fe657026-5782-4049-8e70-928ca87dd2e9 for instance with vm_state deleted and task_state None.
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-1190884b-0f2b-49e1-b096-e10f832fd201 req-ea5ef83f-2b80-4d62-a777-bd901a666728 service nova] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Received event network-vif-deleted-fe657026-5782-4049-8e70-928ca87dd2e9 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "710b4ed6-847f-4ff3-b019-d37b94178768" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-255c319a-6d7c-45cf-b58c-731dd6d3e806 tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "84bdfb26-f639-4431-821c-dcdbe7a55eb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.673s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:22:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:22:58 user nova-compute[72441]: INFO nova.compute.claims [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Claim successful on node user
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:22:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:22:59 user nova-compute[72441]: INFO nova.virt.block_device [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Booting with volume 427ec71a-5b5a-465f-b266-02fee837549e at /dev/vda
Aug 09 19:22:59 user nova-compute[72441]: DEBUG os_brick.utils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[714cb38b-d731-4431-be6c-90ece3fac79a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.policy [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce0e33b1955c4cd8a83fe2a673e22948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6222d55af7e43ef95ee7eaae1ad0bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[db442527-a9a9-4ac5-b1a1-c1b61e6e672b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a200c6-c571-4a38-958a-6f65f8dfc1fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e4f15a-1830-42a9-8a4f-87094e74f3fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:22:59 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:22:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86797950-b03c-49bc-85e9-0f8903eb2b7b]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG os_brick.utils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== get_connector_properties: return (249ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:22:59 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating existing volume attachment record: 1ec92ca9-4c0c-4958-8d63-bceac1fab8c2 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:23:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully created port: 01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:23:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully created port: 126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:23:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully created port: 4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:23:03 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully created port: 2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:23:04 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully created port: 1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: 01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-01b94251-e89f-493a-a778-a719e1f89b92. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG nova.network.neutron [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG nova.network.neutron [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG nova.network.neutron [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a5a4979f-716e-44bd-abbb-6239d849108f req-2765c5c5-135a-4e98-a3ff-39c940b4b4d9 service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: 4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-e499f150-aff2-4041-b359-c053ad8d904b. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:23:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-64bf208f-4d7e-4d29-b998-8f871053d6b4 req-ab944dfe-7d49-4a8a-9917-8359e26a60de service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: 126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-126505f6-c765-45f7-8736-6c1179747ebf. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG nova.network.neutron [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG nova.network.neutron [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: 4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG nova.network.neutron [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd882ff0-11df-4e12-8d89-44ee433cd843 req-d62b7e7a-5b67-4d31-b6d5-75fe2b5d3599 service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:09 user nova-compute[72441]: INFO nova.virt.block_device [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Booting with volume 70e9730d-d80b-4b84-aa2a-6dcca676845d at /dev/vdb
Aug 09 19:23:09 user nova-compute[72441]: DEBUG os_brick.utils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d6892-8b6e-4195-a61e-47e9e68b64b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853399c-2012-4c86-b980-0d4cd1390eec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88dd665-f99f-466e-8d1a-817289ff743c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ad060b-cbca-4101-bfe9-cc3f0367ca9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:23:10 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:23:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58929c8-6e66-4d52-b118-241e14adff31]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG os_brick.utils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating existing volume attachment record: f29c50e8-255e-4240-9c14-87ee36317bc6 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: 2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Successfully updated port: 1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-4818dc25-e7fc-4e6b-9f61-60f9d69237d1. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608976.797301, 84bdfb26-f639-4431-821c-dcdbe7a55eb7 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:23:11 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] VM Stopped (Lifecycle Event)
Aug 09 19:23:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3302109f-10ab-4028-8066-f9afe7a9e8ee None None] [instance: 84bdfb26-f639-4431-821c-dcdbe7a55eb7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:23:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance network_info: |[{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updated VIF entry in instance network info cache for port 4818dc25-e7fc-4e6b-9f61-60f9d69237d1. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-2eedc865-b597-4cff-bfa2-254ce7b182af. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updated VIF entry in instance network info cache for port 2eedc865-b597-4cff-bfa2-254ce7b182af. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-1a1b699f-97cb-4c93-8a7b-df502a7262fd. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updated VIF entry in instance network info cache for port 1a1b699f-97cb-4c93-8a7b-df502a7262fd. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d62f53d9-21ae-40aa-9838-35b02d61ec24 req-310d69a5-b37a-4e04-96df-830033c9aed9 service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-changed-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Refreshing instance network info cache due to event network-changed-2cacd5ec-a169-42d7-b356-5878fa2373ed. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Refreshing network info cache for port 2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updated VIF entry in instance network info cache for port 2cacd5ec-a169-42d7-b356-5878fa2373ed. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b3e87b7a-11b5-4214-9c28-e23114625bbb req-d7f1f80d-8724-469c-bd53-f3c8a91917a6 service nova] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:17 user nova-compute[72441]: INFO nova.compute.manager [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Terminating instance
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Instance destroyed successfully.
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'resources' on Instance uuid 32d57777-50e6-4fcb-b4e1-94b154e69f4d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-379182093',display_name='tempest-AttachVolumeNegativeTest-server-379182093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-379182093',id=3,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI3z3ERYPKvVeABo/lMK8duv4oC2BP2dRc+73Hij9EIHJlvss/NstSNhO0+h4dk/F3U0HhTAhrsMm6pw5o3zHJM9shGdPbo3qbtJjrGuYa2/Fcwj3gx+uQab1KzWUYwrA==',key_name='tempest-keypair-280403461',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-72nbprss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=32d57777-50e6-4fcb-b4e1-94b154e69f4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "a225e308-07c0-4163-a087-b29c61623c4b", "address": "fa:16:3e:36:9f:8e", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa225e308-07", "ovs_interfaceid": "a225e308-07c0-4163-a087-b29c61623c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG os_vif [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa225e308-07, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:17 user nova-compute[72441]: INFO os_vif [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=a225e308-07c0-4163-a087-b29c61623c4b,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa225e308-07')
Aug 09 19:23:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Deleting instance files /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d_del
Aug 09 19:23:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Deletion of /opt/stack/data/nova/instances/32d57777-50e6-4fcb-b4e1-94b154e69f4d_del complete
Aug 09 19:23:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:17 user nova-compute[72441]: INFO nova.compute.manager [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 19:23:17 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:23:17 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-5897dc2f-e1bf-435c-adcd-1aa7ddc495f4 req-eca260ee-f9e6-4d3e-990e-3d2c0ef87489 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-unplugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5897dc2f-e1bf-435c-adcd-1aa7ddc495f4 req-eca260ee-f9e6-4d3e-990e-3d2c0ef87489 service nova] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5897dc2f-e1bf-435c-adcd-1aa7ddc495f4 req-eca260ee-f9e6-4d3e-990e-3d2c0ef87489 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5897dc2f-e1bf-435c-adcd-1aa7ddc495f4 req-eca260ee-f9e6-4d3e-990e-3d2c0ef87489 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-5897dc2f-e1bf-435c-adcd-1aa7ddc495f4 req-eca260ee-f9e6-4d3e-990e-3d2c0ef87489 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] No waiting events found dispatching network-vif-unplugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-5897dc2f-e1bf-435c-adcd-1aa7ddc495f4 req-eca260ee-f9e6-4d3e-990e-3d2c0ef87489 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-unplugged-a225e308-07c0-4163-a087-b29c61623c4b for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:19 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Took 1.17 seconds to deallocate network for instance.
Aug 09 19:23:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-0d6d75e2-b58b-4cdf-ba50-c95110e9690b req-070718ed-43e1-450e-8216-ab4723a9685c service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-deleted-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:19 user nova-compute[72441]: INFO nova.virt.block_device [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Booting with volume 82cb1f53-2f64-4422-84ef-567e124461fc at /dev/vdc
Aug 09 19:23:19 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Deleted allocations for instance 32d57777-50e6-4fcb-b4e1-94b154e69f4d
Aug 09 19:23:19 user nova-compute[72441]: DEBUG os_brick.utils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede21981-2add-4613-a89a-1210af8cae74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6814f2-a1ac-4660-8c8e-aa390960caee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4513983f-31ed-4d88-a1a6-112bfa719a33 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.695s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8333c-f83d-4b65-893d-0987664d9558]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbc9c9-2898-486f-9047-ae59e8282ed0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:23:19 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:23:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e71fa-deef-41d5-9e50-3ce018aaf17b]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG os_brick.utils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:23:19 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating existing volume attachment record: 70286a9e-b747-4667-9869-35f66e941007 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] No waiting events found dispatching network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:20 user nova-compute[72441]: WARNING nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received unexpected event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b for instance with vm_state deleted and task_state None.
Aug 09 19:23:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] No waiting events found dispatching network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:20 user nova-compute[72441]: WARNING nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received unexpected event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b for instance with vm_state deleted and task_state None.
Aug 09 19:23:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Acquiring lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] Lock "32d57777-50e6-4fcb-b4e1-94b154e69f4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] No waiting events found dispatching network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:20 user nova-compute[72441]: WARNING nova.compute.manager [req-192d9399-5e8e-4b5e-8bab-de9eb31c34ee req-20a19ceb-a8dc-4125-94d7-d9391ea23704 service nova] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Received unexpected event network-vif-plugged-a225e308-07c0-4163-a087-b29c61623c4b for instance with vm_state deleted and task_state None.
Aug 09 19:23:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-changed-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing instance network info cache due to event network-changed-01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing network info cache for port 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG nova.network.neutron [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updated VIF entry in instance network info cache for port 01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG nova.network.neutron [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9ca27d5d-09e4-47db-9b9a-6cf3220c1986 req-8c285123-5879-4121-af76-52b1ce7618a6 service nova] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:24 user nova-compute[72441]: INFO nova.compute.manager [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Detaching volume b8517e80-5774-43ac-8262-688c8fda0d8f
Aug 09 19:23:25 user nova-compute[72441]: INFO nova.virt.block_device [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Attempting to driver detach volume b8517e80-5774-43ac-8262-688c8fda0d8f from mountpoint /dev/vdb
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Attempting to detach device vdb from instance 33896e33-6002-4305-9928-e958ec21155b from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:23:25 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:23:25 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:23:25 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:23:25 user nova-compute[72441]:   <serial>b8517e80-5774-43ac-8262-688c8fda0d8f</serial>
Aug 09 19:23:25 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:23:25 user nova-compute[72441]: </disk>
Aug 09 19:23:25 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:23:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully detached device vdb from instance 33896e33-6002-4305-9928-e958ec21155b from the persistent domain config.
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33896e33-6002-4305-9928-e958ec21155b from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:23:25 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:23:25 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:23:25 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:23:25 user nova-compute[72441]:   <serial>b8517e80-5774-43ac-8262-688c8fda0d8f</serial>
Aug 09 19:23:25 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:23:25 user nova-compute[72441]: </disk>
Aug 09 19:23:25 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-changed-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing instance network info cache due to event network-changed-01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] Acquiring lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] Acquired lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Refreshing network info cache for port 01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609005.629799, 33896e33-6002-4305-9928-e958ec21155b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:23:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully detached device vdb from instance 33896e33-6002-4305-9928-e958ec21155b from the live domain config.
Aug 09 19:23:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoeqNpJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:23:25 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e41c67-dd68-4df0-a85d-00ff3375722c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd0f88-4662-4d8d-b3ac-c653fbee15b8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:25 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:23:25 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:25 user nova-compute[72441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f (non-flash)
Aug 09 19:23:25 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd904ec1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c3bc80-a3fc-4ce0-9392-e5e153584d90]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb30ed95-e7c6-4f6d-b9e0-31bd6936e516]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[faccf570-5e0a-45d8-8847-7963774d6ba0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6291d-60c4-4a04-90cd-2d0dac27d280]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[38555c16-6bf7-4fb7-bcc0-ab59d483c500]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df519394-ca74-405a-9635-782d874ec78e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260]
Aug 09 19:23:26 user nova-compute[72441]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f, portal: 172.16.0.220,3260] successful.
Aug 09 19:23:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8517e80-5774-43ac-8262-688c8fda0d8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11441add-25a5-409e-a14d-9327996b4af3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== disconnect_volume: return (431ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updated VIF entry in instance network info cache for port 01b17790-db81-4033-ac01-698aeece1f58. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [{"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a751a8b5-b0a6-4d8c-bb1f-fc9f15f3cc64 req-7a000a9e-40f2-494f-9b04-19dc8987d0f4 service nova] Releasing lock "refresh_cache-33896e33-6002-4305-9928-e958ec21155b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'flavor' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-96e84d4d-31cd-4f5a-9ccb-a4186c0b19c5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.107s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:28 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:23:28 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6863MB free_disk=25.313251495361328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bad8b180-4469-4439-8df9-188ec39a1314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33896e33-6002-4305-9928-e958ec21155b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6af57e2e-ad59-4567-956f-1547e9b97abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 222c489c-36ed-4210-9403-d98927c7f7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 710b4ed6-847f-4ff3-b019-d37b94178768 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:23:28 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:23:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Creating image(s)
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Ensure instance console log exists: /opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Start _get_guest_xml network_info=[{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXubPdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '710b4ed6-847f-4ff3-b019-d37b94178768', 'attached_at': '', 'detached_at': '', 'volume_id': '427ec71a-5b5a-465f-b266-02fee837549e', 'serial': '427ec71a-5b5a-465f-b266-02fee837549e'}, 'attachment_id': '1ec92ca9-4c0c-4958-8d63-bceac1fab8c2', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWZlCvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '710b4ed6-847f-4ff3-b019-d37b94178768', 'attached_at': '', 'detached_at': '', 'volume_id': '70e9730d-d80b-4b84-aa2a-6dcca676845d', 'serial': '70e9730d-d80b-4b84-aa2a-6dcca676845d'}, 'attachment_id': 'f29c50e8-255e-4240-9c14-87ee36317bc6', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmafQlGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '710b4ed6-847f-4ff3-b019-d37b94178768', 'attached_at': '', 'detached_at': '', 'volume_id': '82cb1f53-2f64-4422-84ef-567e124461fc', 'serial': '82cb1f53-2f64-4422-84ef-567e124461fc'}, 'attachment_id': '70286a9e-b747-4667-9869-35f66e941007', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:23:29 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:23:29 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXubPdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:23:29 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:29 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:29 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f238bf1-11dd-49e6-8add-0e8abd8966ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:23:29 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5370b9c6-f4c4-4542-8680-617f9c91d50d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e] added
Aug 09 19:23:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bcaf6-814e-4e67-b0bd-54e8587e8546]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324e851-cecc-4ac5-8d94-b3494da08926]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TXubPdMf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TXubPdMf" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f30ce47-4805-40fb-8e53-f28f0e92ea72]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TXubPdMf'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a9d46-4985-45b2-84ab-90720258d5b0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b20d710-2382-4f2d-a509-4424b6a2fa83]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b57f8ce-1a0c-4c8d-b179-9a0c1edd89a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260]
Aug 09 19:23:29 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260] successful.
Aug 09 19:23:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7088166d-4725-47d3-9c99-a4f554fe2cd3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[64400c87-7f0f-488e-a6d5-2ecd70d6e26c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:29 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2938c5b9-5020-444d-91b8-5448a93e3157]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:23:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXubPdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23638303562346661', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638303562346661', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWZlCvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:23:30 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:30 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:30 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be5917-213c-4e04-830b-1d28d8fcf267]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:23:30 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f5e73f-2403-4d5d-85e7-4f06a5651348]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d] added
Aug 09 19:23:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[466ab122-28dd-493b-a6cd-b383a56b7200]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d558f0-018d-40d7-bb85-fe3a04ed87b6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWZlCvzG {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWZlCvzG" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95556e6-0a92-4714-8846-aeaacd283d5e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kWZlCvzG'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f6677a-6f84-4990-ad30-a9820d44caa7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39688d-7519-4854-8330-c7d16da3e64f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[166c7800-4841-4406-896b-cf9c1c55330e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260]
Aug 09 19:23:31 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260] successful.
Aug 09 19:23:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b96a94-b24e-49fb-8b38-f218e9e6f6b9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f6e2f-7cae-4618-abe4-6ac0e28da700]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:23:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:31 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:23:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d454d06-d4e8-47a4-a714-73002ad5f339]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:23:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWZlCvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23031343036373263', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031343036373263', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmafQlGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:23:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:23:32 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db3b27-6ff6-4a0b-a374-56e6fa2275ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:23:32 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[913c11f6-e327-48ef-bbdb-4698ce4933d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc] added
Aug 09 19:23:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[84327008-fbd5-491d-ab05-d8e832d6cae0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92955b6-e6cc-44a4-9eef-c0848c939b52]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmafQlGw {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmafQlGw" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c48f2-5f6d-43ae-a751-e0936d23067d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YmafQlGw'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86835ba8-4928-4e7e-aaa4-23ce330ee360]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b9ed8d-dc4a-4093-b928-7ee5942e3b0e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:23:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:23:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[189bc1ca-fabd-40e0-9dbe-323de23ddc1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260]
Aug 09 19:23:32 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260] successful.
Aug 09 19:23:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[288776b2-a8ad-4940-b246-46ed8e795104]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb28b3a-f871-4008-b305-9a8fa36e09ec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:23:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:23:32 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:23:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a666b-4312-41cf-a89d-0d4fadc3e13b]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmafQlGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691608997.828049, 32d57777-50e6-4fcb-b4e1-94b154e69f4d => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:23:32 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] VM Stopped (Lifecycle Event)
Aug 09 19:23:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-02d5a1a8-ea43-4a76-86c1-c5793f144907 None None] [instance: 32d57777-50e6-4fcb-b4e1-94b154e69f4d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:23:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26365313863623461', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365313863623461', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lazy-loading 'pci_devices' on Instance uuid 710b4ed6-847f-4ff3-b019-d37b94178768 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:23:33 user nova-compute[72441]:   <uuid>710b4ed6-847f-4ff3-b019-d37b94178768</uuid>
Aug 09 19:23:33 user nova-compute[72441]:   <name>instance-00000016</name>
Aug 09 19:23:33 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:23:33 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:23:33 user nova-compute[72441]:   <metadata>
Aug 09 19:23:33 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:23:33 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:23:33 user nova-compute[72441]:       <nova:name>tempest-device-tagging-server-2109056246</nova:name>
Aug 09 19:23:33 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:23:29</nova:creationTime>
Aug 09 19:23:33 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:23:33 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:23:33 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:23:33 user nova-compute[72441]:       <nova:owner>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:user uuid="ce0e33b1955c4cd8a83fe2a673e22948">tempest-TaggedBootDevicesTest_v242-986195262-project-member</nova:user>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:project uuid="a6222d55af7e43ef95ee7eaae1ad0bfb">tempest-TaggedBootDevicesTest_v242-986195262</nova:project>
Aug 09 19:23:33 user nova-compute[72441]:       </nova:owner>
Aug 09 19:23:33 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:23:33 user nova-compute[72441]:       <nova:ports>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="01b94251-e89f-493a-a778-a719e1f89b92">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="4893ff1f-461c-4a00-a5cc-beba6cf2d8b5">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="e499f150-aff2-4041-b359-c053ad8d904b">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="126505f6-c765-45f7-8736-6c1179747ebf">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="4818dc25-e7fc-4e6b-9f61-60f9d69237d1">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="2eedc865-b597-4cff-bfa2-254ce7b182af">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:         <nova:port uuid="1a1b699f-97cb-4c93-8a7b-df502a7262fd">
Aug 09 19:23:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 19:23:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:23:33 user nova-compute[72441]:       </nova:ports>
Aug 09 19:23:33 user nova-compute[72441]:     </nova:instance>
Aug 09 19:23:33 user nova-compute[72441]:   </metadata>
Aug 09 19:23:33 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:23:33 user nova-compute[72441]:     <system>
Aug 09 19:23:33 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:23:33 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:23:33 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:23:33 user nova-compute[72441]:       <entry name="serial">710b4ed6-847f-4ff3-b019-d37b94178768</entry>
Aug 09 19:23:33 user nova-compute[72441]:       <entry name="uuid">710b4ed6-847f-4ff3-b019-d37b94178768</entry>
Aug 09 19:23:33 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:23:33 user nova-compute[72441]:     </system>
Aug 09 19:23:33 user nova-compute[72441]:   </sysinfo>
Aug 09 19:23:33 user nova-compute[72441]:   <os>
Aug 09 19:23:33 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:23:33 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:23:33 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:23:33 user nova-compute[72441]:   </os>
Aug 09 19:23:33 user nova-compute[72441]:   <features>
Aug 09 19:23:33 user nova-compute[72441]:     <acpi/>
Aug 09 19:23:33 user nova-compute[72441]:     <apic/>
Aug 09 19:23:33 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:23:33 user nova-compute[72441]:   </features>
Aug 09 19:23:33 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:23:33 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:23:33 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:23:33 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:23:33 user nova-compute[72441]:   </clock>
Aug 09 19:23:33 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:23:33 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:23:33 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:23:33 user nova-compute[72441]:   </cpu>
Aug 09 19:23:33 user nova-compute[72441]:   <devices>
Aug 09 19:23:33 user nova-compute[72441]:     <disk type="file" device="cdrom">
Aug 09 19:23:33 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 19:23:33 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768/disk.config"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="hda" bus="ide"/>
Aug 09 19:23:33 user nova-compute[72441]:     </disk>
Aug 09 19:23:33 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:23:33 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:23:33 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <serial>427ec71a-5b5a-465f-b266-02fee837549e</serial>
Aug 09 19:23:33 user nova-compute[72441]:     </disk>
Aug 09 19:23:33 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:23:33 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:23:33 user nova-compute[72441]:       <source dev="/dev/sdc"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <serial>70e9730d-d80b-4b84-aa2a-6dcca676845d</serial>
Aug 09 19:23:33 user nova-compute[72441]:     </disk>
Aug 09 19:23:33 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:23:33 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:23:33 user nova-compute[72441]:       <source dev="/dev/sde"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="vdc" bus="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <serial>82cb1f53-2f64-4422-84ef-567e124461fc</serial>
Aug 09 19:23:33 user nova-compute[72441]:     </disk>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:fa:d8:b3"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tap01b94251-e8"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:21:97:ca"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tap4893ff1f-46"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:64:9a:42"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tape499f150-af"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:31:61:ef"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tap126505f6-c7"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:47:43:15"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tap4818dc25-e7"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:06:0f:14"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tap2eedc865-b5"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:23:33 user nova-compute[72441]:       <mac address="fa:16:3e:a2:e4:7e"/>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:23:33 user nova-compute[72441]:       <target dev="tap1a1b699f-97"/>
Aug 09 19:23:33 user nova-compute[72441]:     </interface>
Aug 09 19:23:33 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:23:33 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768/console.log" append="off"/>
Aug 09 19:23:33 user nova-compute[72441]:     </serial>
Aug 09 19:23:33 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:23:33 user nova-compute[72441]:     <video>
Aug 09 19:23:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:23:33 user nova-compute[72441]:     </video>
Aug 09 19:23:33 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:23:33 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:23:33 user nova-compute[72441]:     </rng>
Aug 09 19:23:33 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:23:33 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:23:33 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:23:33 user nova-compute[72441]:     </memballoon>
Aug 09 19:23:33 user nova-compute[72441]:   </devices>
Aug 09 19:23:33 user nova-compute[72441]: </domain>
Aug 09 19:23:33 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b94251-e8, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01b94251-e8, col_values=(('external_ids', {'iface-id': '01b94251-e89f-493a-a778-a719e1f89b92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:d8:b3', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4893ff1f-46, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4893ff1f-46, col_values=(('external_ids', {'iface-id': '4893ff1f-461c-4a00-a5cc-beba6cf2d8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:97:ca', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape499f150-af, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape499f150-af, col_values=(('external_ids', {'iface-id': 'e499f150-aff2-4041-b359-c053ad8d904b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:9a:42', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap126505f6-c7, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap126505f6-c7, col_values=(('external_ids', {'iface-id': '126505f6-c765-45f7-8736-6c1179747ebf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:61:ef', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4818dc25-e7, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4818dc25-e7, col_values=(('external_ids', {'iface-id': '4818dc25-e7fc-4e6b-9f61-60f9d69237d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:43:15', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eedc865-b5, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eedc865-b5, col_values=(('external_ids', {'iface-id': '2eedc865-b597-4cff-bfa2-254ce7b182af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:0f:14', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a1b699f-97, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a1b699f-97, col_values=(('external_ids', {'iface-id': '1a1b699f-97cb-4c93-8a7b-df502a7262fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:e4:7e', 'vm-uuid': '710b4ed6-847f-4ff3-b019-d37b94178768'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:34 user nova-compute[72441]: INFO os_vif [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97')
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] No BDM found with device name hda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] No VIF found with MAC fa:16:3e:fa:d8:b3, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] No VIF found with MAC fa:16:3e:47:43:15, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:23:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Using config drive
Aug 09 19:23:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Creating config drive at /opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768/disk.config
Aug 09 19:23:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmzioyh18 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:23:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmzioyh18" returned: 0 in 0.059s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:23:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f97aede-e922-4fed-850d-85f4994fdada req-cbfa7bb0-a7be-4c90-b452-cea2b2079e63 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f97aede-e922-4fed-850d-85f4994fdada req-cbfa7bb0-a7be-4c90-b452-cea2b2079e63 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f97aede-e922-4fed-850d-85f4994fdada req-cbfa7bb0-a7be-4c90-b452-cea2b2079e63 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f97aede-e922-4fed-850d-85f4994fdada req-cbfa7bb0-a7be-4c90-b452-cea2b2079e63 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f97aede-e922-4fed-850d-85f4994fdada req-cbfa7bb0-a7be-4c90-b452-cea2b2079e63 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:36 user nova-compute[72441]: WARNING nova.compute.manager [req-7f97aede-e922-4fed-850d-85f4994fdada req-cbfa7bb0-a7be-4c90-b452-cea2b2079e63 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 for instance with vm_state building and task_state spawning.
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-fc0aca8f-4ba1-42ed-8e18-308b944f7581 req-feb627cf-8516-4be2-ad75-d13a2718f4a4 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fc0aca8f-4ba1-42ed-8e18-308b944f7581 req-feb627cf-8516-4be2-ad75-d13a2718f4a4 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fc0aca8f-4ba1-42ed-8e18-308b944f7581 req-feb627cf-8516-4be2-ad75-d13a2718f4a4 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fc0aca8f-4ba1-42ed-8e18-308b944f7581 req-feb627cf-8516-4be2-ad75-d13a2718f4a4 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-fc0aca8f-4ba1-42ed-8e18-308b944f7581 req-feb627cf-8516-4be2-ad75-d13a2718f4a4 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:37 user nova-compute[72441]: WARNING nova.compute.manager [req-fc0aca8f-4ba1-42ed-8e18-308b944f7581 req-feb627cf-8516-4be2-ad75-d13a2718f4a4 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b for instance with vm_state building and task_state spawning.
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-635d2867-9a7b-402f-88d0-983ad51b5cd1 req-336425ba-dbc7-431f-89ec-90ae3327d4c2 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-635d2867-9a7b-402f-88d0-983ad51b5cd1 req-336425ba-dbc7-431f-89ec-90ae3327d4c2 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-635d2867-9a7b-402f-88d0-983ad51b5cd1 req-336425ba-dbc7-431f-89ec-90ae3327d4c2 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-635d2867-9a7b-402f-88d0-983ad51b5cd1 req-336425ba-dbc7-431f-89ec-90ae3327d4c2 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-635d2867-9a7b-402f-88d0-983ad51b5cd1 req-336425ba-dbc7-431f-89ec-90ae3327d4c2 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-635d2867-9a7b-402f-88d0-983ad51b5cd1 req-336425ba-dbc7-431f-89ec-90ae3327d4c2 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:38 user nova-compute[72441]: WARNING nova.compute.manager [req-17182c8e-36f1-4fce-b866-876345596575 req-f718cfc6-dc7f-429c-9f67-6ffebde3dbf8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 for instance with vm_state building and task_state spawning.
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-aabdcc18-4af4-4d84-8eef-f9b9b1880537 req-201ac452-531e-489c-af67-0490981384b6 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-aabdcc18-4af4-4d84-8eef-f9b9b1880537 req-201ac452-531e-489c-af67-0490981384b6 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-aabdcc18-4af4-4d84-8eef-f9b9b1880537 req-201ac452-531e-489c-af67-0490981384b6 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-aabdcc18-4af4-4d84-8eef-f9b9b1880537 req-201ac452-531e-489c-af67-0490981384b6 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-aabdcc18-4af4-4d84-8eef-f9b9b1880537 req-201ac452-531e-489c-af67-0490981384b6 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:39 user nova-compute[72441]: WARNING nova.compute.manager [req-aabdcc18-4af4-4d84-8eef-f9b9b1880537 req-201ac452-531e-489c-af67-0490981384b6 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b for instance with vm_state building and task_state spawning.
Aug 09 19:23:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:40 user nova-compute[72441]: WARNING nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 for instance with vm_state building and task_state spawning.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:40 user nova-compute[72441]: WARNING nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd for instance with vm_state building and task_state spawning.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:40 user nova-compute[72441]: WARNING nova.compute.manager [req-d466a12e-3435-47fc-a68f-424a36d72fe3 req-2651a1e0-7d85-47f6-b26e-0e4152ee9f9d service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd for instance with vm_state building and task_state spawning.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-033a99d8-8883-4eb7-8430-6b6092d9b993 req-b64059d8-a71a-4e99-8ac2-3ba08476c29c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-033a99d8-8883-4eb7-8430-6b6092d9b993 req-b64059d8-a71a-4e99-8ac2-3ba08476c29c service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-033a99d8-8883-4eb7-8430-6b6092d9b993 req-b64059d8-a71a-4e99-8ac2-3ba08476c29c service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-033a99d8-8883-4eb7-8430-6b6092d9b993 req-b64059d8-a71a-4e99-8ac2-3ba08476c29c service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-033a99d8-8883-4eb7-8430-6b6092d9b993 req-b64059d8-a71a-4e99-8ac2-3ba08476c29c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:40 user nova-compute[72441]: WARNING nova.compute.manager [req-033a99d8-8883-4eb7-8430-6b6092d9b993 req-b64059d8-a71a-4e99-8ac2-3ba08476c29c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af for instance with vm_state building and task_state spawning.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609020.605224, 710b4ed6-847f-4ff3-b019-d37b94178768 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] VM Resumed (Lifecycle Event)
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance spawned successfully.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609020.6103997, 710b4ed6-847f-4ff3-b019-d37b94178768 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] VM Started (Lifecycle Event)
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Took 11.37 seconds to spawn the instance on the hypervisor.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:23:40 user nova-compute[72441]: INFO nova.compute.manager [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Took 42.15 seconds to build instance.
Aug 09 19:23:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6b17f496-f928-41f2-a086-331fa1cfaae1 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "710b4ed6-847f-4ff3-b019-d37b94178768" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.338s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 222c489c-36ed-4210-9403-d98927c7f7fe {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 710b4ed6-847f-4ff3-b019-d37b94178768 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "bad8b180-4469-4439-8df9-188ec39a1314" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "222c489c-36ed-4210-9403-d98927c7f7fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "710b4ed6-847f-4ff3-b019-d37b94178768" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:45 user nova-compute[72441]: WARNING oslo_messaging._drivers.amqpdriver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "bad8b180-4469-4439-8df9-188ec39a1314" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "222c489c-36ed-4210-9403-d98927c7f7fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "710b4ed6-847f-4ff3-b019-d37b94178768" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:51 user nova-compute[72441]: INFO nova.compute.manager [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Terminating instance
Aug 09 19:23:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-f87c3504-09c6-4222-8698-86ed1bba4c3b req-48696231-a025-4470-81d8-f66539d31f5c service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-vif-unplugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f87c3504-09c6-4222-8698-86ed1bba4c3b req-48696231-a025-4470-81d8-f66539d31f5c service nova] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f87c3504-09c6-4222-8698-86ed1bba4c3b req-48696231-a025-4470-81d8-f66539d31f5c service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f87c3504-09c6-4222-8698-86ed1bba4c3b req-48696231-a025-4470-81d8-f66539d31f5c service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-f87c3504-09c6-4222-8698-86ed1bba4c3b req-48696231-a025-4470-81d8-f66539d31f5c service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] No waiting events found dispatching network-vif-unplugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-f87c3504-09c6-4222-8698-86ed1bba4c3b req-48696231-a025-4470-81d8-f66539d31f5c service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-vif-unplugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Instance destroyed successfully.
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.objects.instance [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lazy-loading 'resources' on Instance uuid bad8b180-4469-4439-8df9-188ec39a1314 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-587874327',display_name='tempest-VolumesAdminNegativeTest-server-587874327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-587874327',id=5,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICMXcMVKHl99zKEPUeIbowufPTrg+Sajqf3DtAwPu525+xxBD5X9oGCduHdVv8t9XayvHhi1z4LeDKicWSaJhaBlkNkFHyF7BxVlY5HC3b2OAhjRs22BcWQRy+s+zj84A==',key_name='tempest-keypair-1198643854',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f126de4ac5498786e47415c7e5ada4',ramdisk_id='',reservation_id='r-zvvi7qz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1423875380',owner_user_name='tempest-VolumesAdminNegativeTest-1423875380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8c8b477c2d348c78e4ef1175a2b2c09',uuid=bad8b180-4469-4439-8df9-188ec39a1314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converting VIF {"id": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "address": "fa:16:3e:b5:a7:be", "network": {"id": "398a8156-0aa8-4335-89f5-45daf1278fcd", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1494974114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f126de4ac5498786e47415c7e5ada4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0b584c-4d", "ovs_interfaceid": "6c0b584c-4d26-4bc9-826f-e776c4f6c43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG os_vif [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c0b584c-4d, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:23:52 user nova-compute[72441]: INFO os_vif [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a7:be,bridge_name='br-int',has_traffic_filtering=True,id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d,network=Network(398a8156-0aa8-4335-89f5-45daf1278fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0b584c-4d')
Aug 09 19:23:52 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Deleting instance files /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314_del
Aug 09 19:23:52 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Deletion of /opt/stack/data/nova/instances/bad8b180-4469-4439-8df9-188ec39a1314_del complete
Aug 09 19:23:52 user nova-compute[72441]: INFO nova.compute.manager [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 19:23:52 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:23:52 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-c924415a-9c3b-4d24-850f-2392b78ba98e req-b2e1e295-806d-4012-ad12-8126a3caf06c service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c924415a-9c3b-4d24-850f-2392b78ba98e req-b2e1e295-806d-4012-ad12-8126a3caf06c service nova] Acquiring lock "bad8b180-4469-4439-8df9-188ec39a1314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c924415a-9c3b-4d24-850f-2392b78ba98e req-b2e1e295-806d-4012-ad12-8126a3caf06c service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c924415a-9c3b-4d24-850f-2392b78ba98e req-b2e1e295-806d-4012-ad12-8126a3caf06c service nova] Lock "bad8b180-4469-4439-8df9-188ec39a1314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-c924415a-9c3b-4d24-850f-2392b78ba98e req-b2e1e295-806d-4012-ad12-8126a3caf06c service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] No waiting events found dispatching network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:23:54 user nova-compute[72441]: WARNING nova.compute.manager [req-c924415a-9c3b-4d24-850f-2392b78ba98e req-b2e1e295-806d-4012-ad12-8126a3caf06c service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received unexpected event network-vif-plugged-6c0b584c-4d26-4bc9-826f-e776c4f6c43d for instance with vm_state active and task_state deleting.
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-1d4fe802-287a-4b93-9a50-a6bfe7da9144 req-76668482-68a9-4dde-9835-52b91dd7b345 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Received event network-vif-deleted-6c0b584c-4d26-4bc9-826f-e776c4f6c43d {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:23:54 user nova-compute[72441]: INFO nova.compute.manager [req-1d4fe802-287a-4b93-9a50-a6bfe7da9144 req-76668482-68a9-4dde-9835-52b91dd7b345 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Neutron deleted interface 6c0b584c-4d26-4bc9-826f-e776c4f6c43d; detaching it from the instance and deleting it from the info cache
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.network.neutron [req-1d4fe802-287a-4b93-9a50-a6bfe7da9144 req-76668482-68a9-4dde-9835-52b91dd7b345 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:23:54 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Took 1.69 seconds to deallocate network for instance.
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-1d4fe802-287a-4b93-9a50-a6bfe7da9144 req-76668482-68a9-4dde-9835-52b91dd7b345 service nova] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Detach interface failed, port_id=6c0b584c-4d26-4bc9-826f-e776c4f6c43d, reason: Instance bad8b180-4469-4439-8df9-188ec39a1314 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:23:54 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:23:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:23:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:55 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Deleted allocations for instance bad8b180-4469-4439-8df9-188ec39a1314
Aug 09 19:23:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-86da256b-7e4a-4afd-b67c-df3105f9a12d tempest-VolumesAdminNegativeTest-1423875380 tempest-VolumesAdminNegativeTest-1423875380-project-member] Lock "bad8b180-4469-4439-8df9-188ec39a1314" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:23:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:06 user nova-compute[72441]: INFO nova.compute.manager [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Unrescuing
Aug 09 19:24:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:24:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'flavor' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-22162e04-9eac-4e84-85ce-ddd17f40f9dc req-4361048f-752a-4c21-a556-b0ed94c5b917 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-22162e04-9eac-4e84-85ce-ddd17f40f9dc req-4361048f-752a-4c21-a556-b0ed94c5b917 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-22162e04-9eac-4e84-85ce-ddd17f40f9dc req-4361048f-752a-4c21-a556-b0ed94c5b917 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-22162e04-9eac-4e84-85ce-ddd17f40f9dc req-4361048f-752a-4c21-a556-b0ed94c5b917 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-22162e04-9eac-4e84-85ce-ddd17f40f9dc req-4361048f-752a-4c21-a556-b0ed94c5b917 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:07 user nova-compute[72441]: WARNING nova.compute.manager [req-22162e04-9eac-4e84-85ce-ddd17f40f9dc req-4361048f-752a-4c21-a556-b0ed94c5b917 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:24:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:07 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance destroyed successfully.
Aug 09 19:24:07 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609032.7667477, bad8b180-4469-4439-8df9-188ec39a1314 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:07 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: bad8b180-4469-4439-8df9-188ec39a1314] VM Stopped (Lifecycle Event)
Aug 09 19:24:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e2867d60-76e7-466f-94ac-87524e713362 None None] [instance: bad8b180-4469-4439-8df9-188ec39a1314] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:09 user nova-compute[72441]: WARNING nova.compute.manager [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:24:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:09 user nova-compute[72441]: WARNING nova.compute.manager [req-be4ad6ad-8897-471e-8434-b77716ccede2 req-8421d36c-206f-4835-99be-2150a85abe0e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:24:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 4eb07fb7-1056-44f7-a6df-c2d42c64c393 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609051.0486128, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Resumed (Lifecycle Event)
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ed328518-c9ac-4add-8a81-1ecb0704dc44 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609051.050403, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Started (Lifecycle Event)
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a6c0b7e-6409-4934-805e-31f32c4f10ec req-e2c80a04-67da-4d5e-8981-2b7a0072a8e5 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a6c0b7e-6409-4934-805e-31f32c4f10ec req-e2c80a04-67da-4d5e-8981-2b7a0072a8e5 service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a6c0b7e-6409-4934-805e-31f32c4f10ec req-e2c80a04-67da-4d5e-8981-2b7a0072a8e5 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a6c0b7e-6409-4934-805e-31f32c4f10ec req-e2c80a04-67da-4d5e-8981-2b7a0072a8e5 service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a6c0b7e-6409-4934-805e-31f32c4f10ec req-e2c80a04-67da-4d5e-8981-2b7a0072a8e5 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:11 user nova-compute[72441]: WARNING nova.compute.manager [req-9a6c0b7e-6409-4934-805e-31f32c4f10ec req-e2c80a04-67da-4d5e-8981-2b7a0072a8e5 service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state active and task_state None.
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:24:11 user nova-compute[72441]: INFO nova.compute.claims [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Claim successful on node user
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:24:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.policy [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30843aacab5b4db3b76b43cf978bc721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae6d33400f3444387a69b9fc79e4b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:24:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Creating image(s)
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "/opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.158s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk 1073741824" returned: 0 in 0.052s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Cannot resize image /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'migration_context' on Instance uuid 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Ensure instance console log exists: /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Successfully created port: 1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Successfully updated port: 1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquired lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-changed-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Refreshing instance network info cache due to event network-changed-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] Acquiring lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updating instance_info_cache with network_info: [{"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Releasing lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Instance network_info: |[{"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] Acquired lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Refreshing network info cache for port 1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Start _get_guest_xml network_info=[{"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:24:14 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:14 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-589522278',display_name='tempest-AttachVolumeNegativeTest-server-589522278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-589522278',id=23,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNriLsb0Qqgw2lDOeL57HrM3diHnaJvw/o5g9XZjFLhrFSCgxqfD3tfG+5UtOpwPPldU8tHwoABlf2+98Erf2q1Swq76fGlZC+NhmQRqZi3/F4krLvq2eYN9kqTobH1yw==',key_name='tempest-keypair-1137834800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-tf9kgqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=672e16b3-4cf0-46df-a0b6-d433f613c2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.objects.instance [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'pci_devices' on Instance uuid 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:24:14 user nova-compute[72441]:   <uuid>672e16b3-4cf0-46df-a0b6-d433f613c2f3</uuid>
Aug 09 19:24:14 user nova-compute[72441]:   <name>instance-00000017</name>
Aug 09 19:24:14 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:24:14 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:24:14 user nova-compute[72441]:   <metadata>
Aug 09 19:24:14 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:24:14 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:24:14 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-589522278</nova:name>
Aug 09 19:24:14 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:24:14</nova:creationTime>
Aug 09 19:24:14 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:24:14 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:24:14 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:24:14 user nova-compute[72441]:       <nova:owner>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:user uuid="30843aacab5b4db3b76b43cf978bc721">tempest-AttachVolumeNegativeTest-2037425419-project-member</nova:user>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:project uuid="8ae6d33400f3444387a69b9fc79e4b75">tempest-AttachVolumeNegativeTest-2037425419</nova:project>
Aug 09 19:24:14 user nova-compute[72441]:       </nova:owner>
Aug 09 19:24:14 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:24:14 user nova-compute[72441]:       <nova:ports>
Aug 09 19:24:14 user nova-compute[72441]:         <nova:port uuid="1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a">
Aug 09 19:24:14 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:24:14 user nova-compute[72441]:         </nova:port>
Aug 09 19:24:14 user nova-compute[72441]:       </nova:ports>
Aug 09 19:24:14 user nova-compute[72441]:     </nova:instance>
Aug 09 19:24:14 user nova-compute[72441]:   </metadata>
Aug 09 19:24:14 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:24:14 user nova-compute[72441]:     <system>
Aug 09 19:24:14 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:24:14 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:24:14 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:24:14 user nova-compute[72441]:       <entry name="serial">672e16b3-4cf0-46df-a0b6-d433f613c2f3</entry>
Aug 09 19:24:14 user nova-compute[72441]:       <entry name="uuid">672e16b3-4cf0-46df-a0b6-d433f613c2f3</entry>
Aug 09 19:24:14 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:24:14 user nova-compute[72441]:     </system>
Aug 09 19:24:14 user nova-compute[72441]:   </sysinfo>
Aug 09 19:24:14 user nova-compute[72441]:   <os>
Aug 09 19:24:14 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:24:14 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:24:14 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:24:14 user nova-compute[72441]:   </os>
Aug 09 19:24:14 user nova-compute[72441]:   <features>
Aug 09 19:24:14 user nova-compute[72441]:     <acpi/>
Aug 09 19:24:14 user nova-compute[72441]:     <apic/>
Aug 09 19:24:14 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:24:14 user nova-compute[72441]:   </features>
Aug 09 19:24:14 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:24:14 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:24:14 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:24:14 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:24:14 user nova-compute[72441]:   </clock>
Aug 09 19:24:14 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:24:14 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:24:14 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:24:14 user nova-compute[72441]:   </cpu>
Aug 09 19:24:14 user nova-compute[72441]:   <devices>
Aug 09 19:24:14 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:24:14 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:24:14 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk"/>
Aug 09 19:24:14 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:24:14 user nova-compute[72441]:     </disk>
Aug 09 19:24:14 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:24:14 user nova-compute[72441]:       <mac address="fa:16:3e:62:39:ec"/>
Aug 09 19:24:14 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:24:14 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:24:14 user nova-compute[72441]:       <target dev="tap1f53a8dc-b0"/>
Aug 09 19:24:14 user nova-compute[72441]:     </interface>
Aug 09 19:24:14 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:24:14 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/console.log" append="off"/>
Aug 09 19:24:14 user nova-compute[72441]:     </serial>
Aug 09 19:24:14 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:24:14 user nova-compute[72441]:     <video>
Aug 09 19:24:14 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:24:14 user nova-compute[72441]:     </video>
Aug 09 19:24:14 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:24:14 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:24:14 user nova-compute[72441]:     </rng>
Aug 09 19:24:14 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:24:14 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:24:14 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:24:14 user nova-compute[72441]:     </memballoon>
Aug 09 19:24:14 user nova-compute[72441]:   </devices>
Aug 09 19:24:14 user nova-compute[72441]: </domain>
Aug 09 19:24:14 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-589522278',display_name='tempest-AttachVolumeNegativeTest-server-589522278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-589522278',id=23,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNriLsb0Qqgw2lDOeL57HrM3diHnaJvw/o5g9XZjFLhrFSCgxqfD3tfG+5UtOpwPPldU8tHwoABlf2+98Erf2q1Swq76fGlZC+NhmQRqZi3/F4krLvq2eYN9kqTobH1yw==',key_name='tempest-keypair-1137834800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-tf9kgqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=672e16b3-4cf0-46df-a0b6-d433f613c2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG os_vif [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f53a8dc-b0, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f53a8dc-b0, col_values=(('external_ids', {'iface-id': '1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:39:ec', 'vm-uuid': '672e16b3-4cf0-46df-a0b6-d433f613c2f3'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:14 user nova-compute[72441]: INFO os_vif [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0')
Aug 09 19:24:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:62:39:ec, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:24:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updated VIF entry in instance network info cache for port 1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:24:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updating instance_info_cache with network_info: [{"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-66c6e931-6c1c-4610-b175-c8ad33d19e81 req-afdb2bce-77ef-470e-8dfd-45a15c689bd1 service nova] Releasing lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-changed-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Refreshing instance network info cache due to event network-changed-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] Acquiring lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] Acquired lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Refreshing network info cache for port 7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-d99ece96-01da-4b8d-9e0a-305069ab1c64 req-b41945ba-e504-4872-a986-5b2ad3159c70 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d99ece96-01da-4b8d-9e0a-305069ab1c64 req-b41945ba-e504-4872-a986-5b2ad3159c70 service nova] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d99ece96-01da-4b8d-9e0a-305069ab1c64 req-b41945ba-e504-4872-a986-5b2ad3159c70 service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d99ece96-01da-4b8d-9e0a-305069ab1c64 req-b41945ba-e504-4872-a986-5b2ad3159c70 service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-d99ece96-01da-4b8d-9e0a-305069ab1c64 req-b41945ba-e504-4872-a986-5b2ad3159c70 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] No waiting events found dispatching network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:16 user nova-compute[72441]: WARNING nova.compute.manager [req-d99ece96-01da-4b8d-9e0a-305069ab1c64 req-b41945ba-e504-4872-a986-5b2ad3159c70 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received unexpected event network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a for instance with vm_state building and task_state spawning.
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updated VIF entry in instance network info cache for port 7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updating instance_info_cache with network_info: [{"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-00532790-9709-4e98-8ccc-750b20f8a323 req-b207dd90-1e71-428d-894e-14b43598a3b1 service nova] Releasing lock "refresh_cache-6af57e2e-ad59-4567-956f-1547e9b97abb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609058.5669599, 672e16b3-4cf0-46df-a0b6-d433f613c2f3 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] VM Resumed (Lifecycle Event)
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Instance spawned successfully.
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609058.5691237, 672e16b3-4cf0-46df-a0b6-d433f613c2f3 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] VM Started (Lifecycle Event)
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:18 user nova-compute[72441]: INFO nova.compute.manager [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Took 6.90 seconds to build instance.
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-906fd63f-9282-4719-a2f1-a4ffc5c38f95 req-16e9e2a1-642d-4abe-ab21-bca5782f887b service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-906fd63f-9282-4719-a2f1-a4ffc5c38f95 req-16e9e2a1-642d-4abe-ab21-bca5782f887b service nova] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-906fd63f-9282-4719-a2f1-a4ffc5c38f95 req-16e9e2a1-642d-4abe-ab21-bca5782f887b service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-906fd63f-9282-4719-a2f1-a4ffc5c38f95 req-16e9e2a1-642d-4abe-ab21-bca5782f887b service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-906fd63f-9282-4719-a2f1-a4ffc5c38f95 req-16e9e2a1-642d-4abe-ab21-bca5782f887b service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] No waiting events found dispatching network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:18 user nova-compute[72441]: WARNING nova.compute.manager [req-906fd63f-9282-4719-a2f1-a4ffc5c38f95 req-16e9e2a1-642d-4abe-ab21-bca5782f887b service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received unexpected event network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a for instance with vm_state active and task_state None.
Aug 09 19:24:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dab2c0a5-dceb-4c96-a52a-c511f7ddf598 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:20 user nova-compute[72441]: INFO nova.compute.manager [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Terminating instance
Aug 09 19:24:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-008e27f0-cdc5-4d26-8bb9-f20160078003 req-82105398-2a69-4cb7-b89d-cac44a9a202d service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-unplugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-008e27f0-cdc5-4d26-8bb9-f20160078003 req-82105398-2a69-4cb7-b89d-cac44a9a202d service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-008e27f0-cdc5-4d26-8bb9-f20160078003 req-82105398-2a69-4cb7-b89d-cac44a9a202d service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-008e27f0-cdc5-4d26-8bb9-f20160078003 req-82105398-2a69-4cb7-b89d-cac44a9a202d service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-008e27f0-cdc5-4d26-8bb9-f20160078003 req-82105398-2a69-4cb7-b89d-cac44a9a202d service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-unplugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-008e27f0-cdc5-4d26-8bb9-f20160078003 req-82105398-2a69-4cb7-b89d-cac44a9a202d service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-unplugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lazy-loading 'flavor' on Instance uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Instance destroyed successfully.
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'resources' on Instance uuid 33896e33-6002-4305-9928-e958ec21155b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-285238595',display_name='tempest-TestMinimumBasicScenario-server-285238595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-285238595',id=12,image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJakhBNZG/Xp7L7bWk5jO8eaYkpuSgT8oEYtn5quizbZ92zPivsA/Ivc/77DanLCOTrX1xOg1fd24upHOeq48uf4kUA9e0mt+5rg1CJmzPzHqzvruTzm+V8BZa0heRH/HQ==',key_name='tempest-TestMinimumBasicScenario-633096993',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-qoqrisl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='32e95858-7fe3-43aa-bce7-59edbd58d401',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:21:40Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=33896e33-6002-4305-9928-e958ec21155b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "01b17790-db81-4033-ac01-698aeece1f58", "address": "fa:16:3e:ce:f2:fe", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b17790-db", "ovs_interfaceid": "01b17790-db81-4033-ac01-698aeece1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG os_vif [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b17790-db, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:21 user nova-compute[72441]: INFO os_vif [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f2:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b17790-db81-4033-ac01-698aeece1f58,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b17790-db')
Aug 09 19:24:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Deleting instance files /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b_del
Aug 09 19:24:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Deletion of /opt/stack/data/nova/instances/33896e33-6002-4305-9928-e958ec21155b_del complete
Aug 09 19:24:21 user nova-compute[72441]: INFO nova.compute.manager [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 33896e33-6002-4305-9928-e958ec21155b] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:21 user nova-compute[72441]: INFO nova.compute.manager [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Attaching volume 71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac to /dev/vdb
Aug 09 19:24:22 user nova-compute[72441]: DEBUG os_brick.utils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5631cc73-16b5-4d5f-a12e-4a56e29f818d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e804cb-d71a-4103-92fa-b65d34e12f1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a416494-a467-4ad4-bd1f-148a23ec2e03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816fc68-bbdc-4a88-a92a-f619833299c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:24:22 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb448fe8-4037-46e6-87b0-9661d39a9323]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG os_brick.utils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updating existing volume attachment record: 6e4f7201-0744-4356-b5b4-2769a5903f0e {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:22 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] Took 0.65 seconds to deallocate network for instance.
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:24:22 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:23 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Deleted allocations for instance 33896e33-6002-4305-9928-e958ec21155b
Aug 09 19:24:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2b62a885-6ac7-4ee3-ba56-d2d1a5edb3e5 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "33896e33-6002-4305-9928-e958ec21155b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] Acquiring lock "33896e33-6002-4305-9928-e958ec21155b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] Lock "33896e33-6002-4305-9928-e958ec21155b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] No waiting events found dispatching network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:23 user nova-compute[72441]: WARNING nova.compute.manager [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received unexpected event network-vif-plugged-01b17790-db81-4033-ac01-698aeece1f58 for instance with vm_state deleted and task_state None.
Aug 09 19:24:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-99a92d2d-1f9a-4825-9e08-b40f71f6935f req-b3efff7a-85d7-42ad-a36f-728bfbf47546 service nova] [instance: 33896e33-6002-4305-9928-e958ec21155b] Received event network-vif-deleted-01b17790-db81-4033-ac01-698aeece1f58 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:23 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:24:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:27 user nova-compute[72441]: INFO nova.compute.manager [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Detaching volume d7cbf10e-2fb1-48d9-bf72-a35acaff2e64
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:27 user nova-compute[72441]: INFO nova.virt.block_device [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Attempting to driver detach volume d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 from mountpoint /dev/vdb
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Attempting to detach device vdb from instance 822fd908-82ec-4e6c-bcab-b190213e67e7 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:24:27 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:24:27 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:24:27 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:24:27 user nova-compute[72441]:   <serial>d7cbf10e-2fb1-48d9-bf72-a35acaff2e64</serial>
Aug 09 19:24:27 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:24:27 user nova-compute[72441]: </disk>
Aug 09 19:24:27 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:24:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully detached device vdb from instance 822fd908-82ec-4e6c-bcab-b190213e67e7 from the persistent domain config.
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 822fd908-82ec-4e6c-bcab-b190213e67e7 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:24:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:24:27 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:24:27 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:24:27 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:24:27 user nova-compute[72441]:   <serial>d7cbf10e-2fb1-48d9-bf72-a35acaff2e64</serial>
Aug 09 19:24:27 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:24:27 user nova-compute[72441]: </disk>
Aug 09 19:24:27 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609068.4128554, 822fd908-82ec-4e6c-bcab-b190213e67e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:24:28 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully detached device vdb from instance 822fd908-82ec-4e6c-bcab-b190213e67e7 from the live domain config.
Aug 09 19:24:28 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:28 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7033MB free_disk=25.340126037597656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueiFvUsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:28 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ac306-fe35-4598-8e82-e89c4bdc9b4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86437509-3039-4911-a37a-bdca57ed3533]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:28 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:28 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:28 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905cdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:24:28 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77234c0-465a-400d-b3fe-101ad1e496c4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ec818-684e-464f-ba35-6e281b59b181]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6af57e2e-ad59-4567-956f-1547e9b97abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 222c489c-36ed-4210-9403-d98927c7f7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 710b4ed6-847f-4ff3-b019-d37b94178768 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[45354046-6d7e-4a84-94a3-079d43f1ed4f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49b768f-5651-47f7-8ef7-2a95fc4b1faa]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64265a-d29d-4963-8eff-7de18eb8f450]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "222c489c-36ed-4210-9403-d98927c7f7fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:29 user nova-compute[72441]: INFO nova.compute.manager [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Terminating instance
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da94d15-c8c3-4c24-a67f-4b6fbeb50ef2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260]
Aug 09 19:24:29 user nova-compute[72441]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cbf10e-2fb1-48d9-bf72-a35acaff2e64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07bef8d-eecb-4633-a0a2-111fbadd7260]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== disconnect_volume: return (406ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a4a5174-8212-46ab-971d-b4a9e81f04aa req-ab55285f-817c-411b-91ee-78cc32499fae service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-vif-unplugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a4a5174-8212-46ab-971d-b4a9e81f04aa req-ab55285f-817c-411b-91ee-78cc32499fae service nova] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a4a5174-8212-46ab-971d-b4a9e81f04aa req-ab55285f-817c-411b-91ee-78cc32499fae service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6a4a5174-8212-46ab-971d-b4a9e81f04aa req-ab55285f-817c-411b-91ee-78cc32499fae service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a4a5174-8212-46ab-971d-b4a9e81f04aa req-ab55285f-817c-411b-91ee-78cc32499fae service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] No waiting events found dispatching network-vif-unplugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-6a4a5174-8212-46ab-971d-b4a9e81f04aa req-ab55285f-817c-411b-91ee-78cc32499fae service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-vif-unplugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Instance destroyed successfully.
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.objects.instance [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lazy-loading 'resources' on Instance uuid 222c489c-36ed-4210-9403-d98927c7f7fe {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2123769625',display_name='tempest-VolumesActionsTest-instance-2123769625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2123769625',id=19,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd1c396deeca4c219140761e4bd8141d',ramdisk_id='',reservation_id='r-4g76qem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-57443595',owner_user_name='tempest-VolumesActionsTest-57443595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:22:48Z,user_data=None,user_id='e95cede1cc2549dfb6c82d2baeaaf39a',uuid=222c489c-36ed-4210-9403-d98927c7f7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converting VIF {"id": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "address": "fa:16:3e:83:8c:3d", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4cb1a4-26", "ovs_interfaceid": "9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG os_vif [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c4cb1a4-26, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:30 user nova-compute[72441]: INFO os_vif [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:3d,bridge_name='br-int',has_traffic_filtering=True,id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4cb1a4-26')
Aug 09 19:24:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Deleting instance files /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe_del
Aug 09 19:24:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Deletion of /opt/stack/data/nova/instances/222c489c-36ed-4210-9403-d98927c7f7fe_del complete
Aug 09 19:24:30 user nova-compute[72441]: INFO nova.compute.manager [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 19:24:30 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'flavor' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5cccb651-a1fd-4395-9b02-5f8de4d61cab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.491s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-5b4fda76-0c8b-49b6-b798-8a6691cf26d7 req-4185816c-58aa-470f-aa01-a35c67ff238a service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-vif-deleted-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:31 user nova-compute[72441]: INFO nova.compute.manager [req-5b4fda76-0c8b-49b6-b798-8a6691cf26d7 req-4185816c-58aa-470f-aa01-a35c67ff238a service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Neutron deleted interface 9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103; detaching it from the instance and deleting it from the info cache
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.network.neutron [req-5b4fda76-0c8b-49b6-b798-8a6691cf26d7 req-4185816c-58aa-470f-aa01-a35c67ff238a service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:31 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Took 0.88 seconds to deallocate network for instance.
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-5b4fda76-0c8b-49b6-b798-8a6691cf26d7 req-4185816c-58aa-470f-aa01-a35c67ff238a service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Detach interface failed, port_id=9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103, reason: Instance 222c489c-36ed-4210-9403-d98927c7f7fe could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:31 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Deleted allocations for instance 222c489c-36ed-4210-9403-d98927c7f7fe
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50451718-81d8-43dd-9eb3-26df5c47d613 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "222c489c-36ed-4210-9403-d98927c7f7fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-5ba016d5-334a-401d-932b-5f988c0b031c req-79162355-93c3-4ad3-aff3-6ff4bf11e7fc service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received event network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5ba016d5-334a-401d-932b-5f988c0b031c req-79162355-93c3-4ad3-aff3-6ff4bf11e7fc service nova] Acquiring lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5ba016d5-334a-401d-932b-5f988c0b031c req-79162355-93c3-4ad3-aff3-6ff4bf11e7fc service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5ba016d5-334a-401d-932b-5f988c0b031c req-79162355-93c3-4ad3-aff3-6ff4bf11e7fc service nova] Lock "222c489c-36ed-4210-9403-d98927c7f7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-5ba016d5-334a-401d-932b-5f988c0b031c req-79162355-93c3-4ad3-aff3-6ff4bf11e7fc service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] No waiting events found dispatching network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:31 user nova-compute[72441]: WARNING nova.compute.manager [req-5ba016d5-334a-401d-932b-5f988c0b031c req-79162355-93c3-4ad3-aff3-6ff4bf11e7fc service nova] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Received unexpected event network-vif-plugged-9c4cb1a4-2659-4436-bb2b-ff9f0e9e2103 for instance with vm_state deleted and task_state None.
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrhfsQDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:31 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:31 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:31 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4389e-608a-4acb-866c-d1577992bdf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:24:31 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4538fcf5-c6c2-49ca-ad90-bcd95064947c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac] added
Aug 09 19:24:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70fecc8-edd0-405c-9514-6f60b578f934]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4812ca6-0840-4ddb-870a-4735a7236841]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrhfsQDG {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrhfsQDG" returned: 0 in 0.066s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9b3024-5e85-4a68-aaf8-cbca5b474f03]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrhfsQDG'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updating instance_info_cache with network_info: [{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88685c8a-38fa-405f-8e1e-485f15f5ea81]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c111e158-d7e7-4b2e-b0bd-06ddc263689e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb0bfc-9792-4201-8941-1cb508e82f69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260]
Aug 09 19:24:32 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d345be2d-6533-4f12-94f3-42b4e7e6da0c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910fa7a-695b-4340-b720-e22595f658ce]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac (non-flash)
Aug 09 19:24:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:32 user nova-compute[72441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac (non-flash)
Aug 09 19:24:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f4549-12c5-4f32-8956-3d6b4c7c9438]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:24:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrhfsQDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26236636632333237', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236636632333237', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lazy-loading 'flavor' on Instance uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:24:33 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:24:33 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:24:33 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:24:33 user nova-compute[72441]:   <serial>71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac</serial>
Aug 09 19:24:33 user nova-compute[72441]: </disk>
Aug 09 19:24:33 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:33 user nova-compute[72441]: INFO nova.compute.manager [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Unshelving
Aug 09 19:24:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] No VIF found with MAC fa:16:3e:ae:13:ed, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:24:33 user nova-compute[72441]: INFO nova.virt.block_device [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Booting with volume 2f97fa00-be47-4cc2-8a0d-7276726b4001 at /dev/vdc
Aug 09 19:24:33 user nova-compute[72441]: DEBUG os_brick.utils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-20d25439-a231-4962-99ab-cb8ec1eaf557 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.966s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05255eb-ce63-46c8-9f45-c144f4b0355b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0b37d-4cb3-41a2-855a-4511715bd696]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc13e62-77be-4cd6-8f7c-86ba01b3d09f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cd93d5-de9b-42dc-ae5d-fcad56dfeb18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:24:34 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:24:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe698ca-f09e-4cc1-858d-542221263d2d]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG os_brick.utils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:34 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating existing volume attachment record: 54cc3c13-20bd-48e4-98d1-5f9afbde195f {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:24:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:36 user nova-compute[72441]: INFO nova.compute.manager [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Detaching volume 71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac
Aug 09 19:24:36 user nova-compute[72441]: INFO nova.virt.block_device [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Attempting to driver detach volume 71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac from mountpoint /dev/vdb
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Attempting to detach device vdb from instance 6af57e2e-ad59-4567-956f-1547e9b97abb from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:24:36 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:24:36 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:24:36 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:24:36 user nova-compute[72441]:   <serial>71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac</serial>
Aug 09 19:24:36 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:24:36 user nova-compute[72441]: </disk>
Aug 09 19:24:36 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:24:36 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Successfully detached device vdb from instance 6af57e2e-ad59-4567-956f-1547e9b97abb from the persistent domain config.
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6af57e2e-ad59-4567-956f-1547e9b97abb from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:24:36 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:24:36 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:24:36 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:24:36 user nova-compute[72441]:   <serial>71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac</serial>
Aug 09 19:24:36 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:24:36 user nova-compute[72441]: </disk>
Aug 09 19:24:36 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609061.7491024, 33896e33-6002-4305-9928-e958ec21155b => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:36 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 33896e33-6002-4305-9928-e958ec21155b] VM Stopped (Lifecycle Event)
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a18a52a1-2bf6-471e-a8eb-3337f7412edb None None] [instance: 33896e33-6002-4305-9928-e958ec21155b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609076.9037488, 6af57e2e-ad59-4567-956f-1547e9b97abb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:24:36 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Successfully detached device vdb from instance 6af57e2e-ad59-4567-956f-1547e9b97abb from the live domain config.
Aug 09 19:24:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrhfsQDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:36 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2734d-1121-4c51-8e8f-df77c1ae0c79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427577a-2171-44bc-87c5-caaa728aacf6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac (non-flash)
Aug 09 19:24:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:36 user nova-compute[72441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac (non-flash)
Aug 09 19:24:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbda0fcf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:24:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f259e49d-b172-43ef-b155-5e349d2e399f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d113a-8827-4a25-8548-8471fb22692f]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a6613-ba9c-4edd-8569-f0d4c6d6f05a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf5cc6-0438-470f-ab99-361b314df709]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b1170-d2e4-4bbb-a418-a695fff40e1e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d605d-90ae-4680-a23e-8a5785245c69]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260]
Aug 09 19:24:37 user nova-compute[72441]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71341fd6-9ae7-4bb0-86e6-d6abc4a9d5ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8239a6b-ebe6-44a7-b071-0f33f7817905]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] <== disconnect_volume: return (298ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lazy-loading 'flavor' on Instance uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-40c7b4a3-9881-49ff-a0be-2968a0011b61 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:38 user nova-compute[72441]: INFO nova.compute.manager [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Rescuing
Aug 09 19:24:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:24:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-37e424b1-f88f-4efb-9878-728347fa8d92 req-ef762902-f7fa-49ad-b85e-3cc905153bda service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-unplugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-37e424b1-f88f-4efb-9878-728347fa8d92 req-ef762902-f7fa-49ad-b85e-3cc905153bda service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-37e424b1-f88f-4efb-9878-728347fa8d92 req-ef762902-f7fa-49ad-b85e-3cc905153bda service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-37e424b1-f88f-4efb-9878-728347fa8d92 req-ef762902-f7fa-49ad-b85e-3cc905153bda service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-37e424b1-f88f-4efb-9878-728347fa8d92 req-ef762902-f7fa-49ad-b85e-3cc905153bda service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-unplugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:39 user nova-compute[72441]: WARNING nova.compute.manager [req-37e424b1-f88f-4efb-9878-728347fa8d92 req-ef762902-f7fa-49ad-b85e-3cc905153bda service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-unplugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state active and task_state rescuing.
Aug 09 19:24:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance destroyed successfully.
Aug 09 19:24:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Attempting rescue
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:24:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Creating image(s)
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'trusted_certs' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue" returned: 0 in 0.055s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'migration_context' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Start _get_guest_xml network_info=[{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:48:0c:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'resources' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'numa_topology' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'vcpu_model' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2124327960',display_name='tempest-ServerRescueNegativeTestJSON-server-2124327960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2124327960',id=21,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-k02t4a5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:57Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=d643ae7c-ca03-4921-b6d2-66433a539cde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:48:0c:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:48:0c:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'pci_devices' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:24:39 user nova-compute[72441]:   <uuid>d643ae7c-ca03-4921-b6d2-66433a539cde</uuid>
Aug 09 19:24:39 user nova-compute[72441]:   <name>instance-00000015</name>
Aug 09 19:24:39 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:24:39 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:24:39 user nova-compute[72441]:   <metadata>
Aug 09 19:24:39 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:24:39 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:24:39 user nova-compute[72441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2124327960</nova:name>
Aug 09 19:24:39 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:24:39</nova:creationTime>
Aug 09 19:24:39 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:24:39 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:24:39 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:24:39 user nova-compute[72441]:       <nova:owner>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:user uuid="3bdbd35f8a0d4f3297acb453e3109176">tempest-ServerRescueNegativeTestJSON-1340711293-project-member</nova:user>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:project uuid="6dcefc0bffad468b82ae957092668524">tempest-ServerRescueNegativeTestJSON-1340711293</nova:project>
Aug 09 19:24:39 user nova-compute[72441]:       </nova:owner>
Aug 09 19:24:39 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:24:39 user nova-compute[72441]:       <nova:ports>
Aug 09 19:24:39 user nova-compute[72441]:         <nova:port uuid="18515de4-95d3-463f-a469-61abac987981">
Aug 09 19:24:39 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 19:24:39 user nova-compute[72441]:         </nova:port>
Aug 09 19:24:39 user nova-compute[72441]:       </nova:ports>
Aug 09 19:24:39 user nova-compute[72441]:     </nova:instance>
Aug 09 19:24:39 user nova-compute[72441]:   </metadata>
Aug 09 19:24:39 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:24:39 user nova-compute[72441]:     <system>
Aug 09 19:24:39 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:24:39 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:24:39 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:24:39 user nova-compute[72441]:       <entry name="serial">d643ae7c-ca03-4921-b6d2-66433a539cde</entry>
Aug 09 19:24:39 user nova-compute[72441]:       <entry name="uuid">d643ae7c-ca03-4921-b6d2-66433a539cde</entry>
Aug 09 19:24:39 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:24:39 user nova-compute[72441]:     </system>
Aug 09 19:24:39 user nova-compute[72441]:   </sysinfo>
Aug 09 19:24:39 user nova-compute[72441]:   <os>
Aug 09 19:24:39 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:24:39 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:24:39 user nova-compute[72441]:   </os>
Aug 09 19:24:39 user nova-compute[72441]:   <features>
Aug 09 19:24:39 user nova-compute[72441]:     <acpi/>
Aug 09 19:24:39 user nova-compute[72441]:     <apic/>
Aug 09 19:24:39 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:24:39 user nova-compute[72441]:   </features>
Aug 09 19:24:39 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:24:39 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:24:39 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:24:39 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:24:39 user nova-compute[72441]:   </clock>
Aug 09 19:24:39 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:24:39 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:24:39 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:24:39 user nova-compute[72441]:   </cpu>
Aug 09 19:24:39 user nova-compute[72441]:   <devices>
Aug 09 19:24:39 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:24:39 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:24:39 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue"/>
Aug 09 19:24:39 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:24:39 user nova-compute[72441]:     </disk>
Aug 09 19:24:39 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:24:39 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:24:39 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk"/>
Aug 09 19:24:39 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:24:39 user nova-compute[72441]:     </disk>
Aug 09 19:24:39 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:24:39 user nova-compute[72441]:       <mac address="fa:16:3e:48:0c:cb"/>
Aug 09 19:24:39 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:24:39 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:24:39 user nova-compute[72441]:       <target dev="tap18515de4-95"/>
Aug 09 19:24:39 user nova-compute[72441]:     </interface>
Aug 09 19:24:39 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:24:39 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/console.log" append="off"/>
Aug 09 19:24:39 user nova-compute[72441]:     </serial>
Aug 09 19:24:39 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:24:39 user nova-compute[72441]:     <video>
Aug 09 19:24:39 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:24:39 user nova-compute[72441]:     </video>
Aug 09 19:24:39 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:24:39 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:24:39 user nova-compute[72441]:     </rng>
Aug 09 19:24:39 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:24:39 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:24:39 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:24:39 user nova-compute[72441]:     </memballoon>
Aug 09 19:24:39 user nova-compute[72441]:   </devices>
Aug 09 19:24:39 user nova-compute[72441]: </domain>
Aug 09 19:24:39 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:24:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance destroyed successfully.
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:48:0c:cb, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:24:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-f0cd91af-205c-4739-a7c5-e1746a615162 req-19b55467-300a-45cb-b66e-d74d4cc0e88d service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f0cd91af-205c-4739-a7c5-e1746a615162 req-19b55467-300a-45cb-b66e-d74d4cc0e88d service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f0cd91af-205c-4739-a7c5-e1746a615162 req-19b55467-300a-45cb-b66e-d74d4cc0e88d service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f0cd91af-205c-4739-a7c5-e1746a615162 req-19b55467-300a-45cb-b66e-d74d4cc0e88d service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-f0cd91af-205c-4739-a7c5-e1746a615162 req-19b55467-300a-45cb-b66e-d74d4cc0e88d service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:41 user nova-compute[72441]: WARNING nova.compute.manager [req-f0cd91af-205c-4739-a7c5-e1746a615162 req-19b55467-300a-45cb-b66e-d74d4cc0e88d service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state active and task_state rescuing.
Aug 09 19:24:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:43 user nova-compute[72441]: WARNING nova.compute.manager [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state active and task_state rescuing.
Aug 09 19:24:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:43 user nova-compute[72441]: WARNING nova.compute.manager [req-d105aa57-0f21-4bb9-ad31-7dbf3a7e8274 req-cf8f2be3-9767-4124-8efc-bd76d412167c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state active and task_state rescuing.
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for d643ae7c-ca03-4921-b6d2-66433a539cde due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609083.9989371, d643ae7c-ca03-4921-b6d2-66433a539cde => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:44 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] VM Resumed (Lifecycle Event)
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c4cf49e2-3b88-4e23-a6a9-0b55d9039a17 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:44 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609084.002024, d643ae7c-ca03-4921-b6d2-66433a539cde => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:44 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] VM Started (Lifecycle Event)
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'pci_requests' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'numa_topology' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:24:44 user nova-compute[72441]: INFO nova.compute.claims [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Claim successful on node user
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:24:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:44 user nova-compute[72441]: INFO nova.network.neutron [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating port 4549fab1-2c9e-42d0-8941-d981d3dee0b7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609070.038641, 222c489c-36ed-4210-9403-d98927c7f7fe => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:45 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] VM Stopped (Lifecycle Event)
Aug 09 19:24:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-aafcd693-e095-4bc8-a765-3f7ba9fa95f4 None None] [instance: 222c489c-36ed-4210-9403-d98927c7f7fe] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing instance network info cache due to event network-changed-4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:24:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] Acquiring lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:24:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Creating image(s)
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] Acquired lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Refreshing network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "b1bee27c3b816352345537bec5e3053394e86f02" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "b1bee27c3b816352345537bec5e3053394e86f02" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.part --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:47 user nova-compute[72441]: DEBUG nova.virt.images [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] 4d61264f-95a2-4536-8edf-68f362c48bc3 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:24:47 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:24:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.part /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG nova.network.neutron [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updated VIF entry in instance network info cache for port 4549fab1-2c9e-42d0-8941-d981d3dee0b7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG nova.network.neutron [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.part /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.converted" returned: 0 in 0.639s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54f26e66-c6eb-435a-994e-ddf1bf8710ce req-91aa1e3c-f0b4-41cf-a85a-05dca28076b5 service nova] Releasing lock "refresh_cache-9993e22d-c00a-497a-bb28-500abdc8a2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "b1bee27c3b816352345537bec5e3053394e86f02" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.183s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02 --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "b1bee27c3b816352345537bec5e3053394e86f02" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "b1bee27c3b816352345537bec5e3053394e86f02" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02 --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02,backing_fmt=raw /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02,backing_fmt=raw /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk 1073741824" returned: 0 in 0.068s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "b1bee27c3b816352345537bec5e3053394e86f02" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02 --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'migration_context' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:48 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Rebasing disk image.
Aug 09 19:24:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.167s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 -F raw /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-changed-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing instance network info cache due to event network-changed-01b94251-e89f-493a-a778-a719e1f89b92. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] Acquiring lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] Acquired lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG nova.network.neutron [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Refreshing network info cache for port 01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.network.neutron [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updated VIF entry in instance network info cache for port 01b94251-e89f-493a-a778-a719e1f89b92. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.network.neutron [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2b9e23ba-2647-44c0-a747-3e46dc94498c req-25cbf023-6926-4dd5-af78-3d5d967ab33c service nova] Releasing lock "refresh_cache-710b4ed6-847f-4ff3-b019-d37b94178768" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 -F raw /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk" returned: 0 in 2.615s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Ensure instance console log exists: /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Start _get_guest_xml network_info=[{"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f5ce8c4b4cf79d12277cdd184afa8561',container_format='bare',created_at=2023-08-09T19:22:40Z,direct_url=<?>,disk_format='qcow2',id=4d61264f-95a2-4536-8edf-68f362c48bc3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1532187531-shelved',owner='5f8e21260bfe4c228b1f97b1dbb7a049',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T19:22:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ospZHUBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9993e22d-c00a-497a-bb28-500abdc8a2f3', 'attached_at': '', 'detached_at': '', 'volume_id': '2f97fa00-be47-4cc2-8a0d-7276726b4001', 'serial': '2f97fa00-be47-4cc2-8a0d-7276726b4001'}, 'attachment_id': '54cc3c13-20bd-48e4-98d1-5f9afbde195f', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:24:51 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:51 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f5ce8c4b4cf79d12277cdd184afa8561',container_format='bare',created_at=2023-08-09T19:22:40Z,direct_url=<?>,disk_format='qcow2',id=4d61264f-95a2-4536-8edf-68f362c48bc3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1532187531-shelved',owner='5f8e21260bfe4c228b1f97b1dbb7a049',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T19:22:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ospZHUBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:51 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:51 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:51 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260" returned: 21 in 0.054s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a504d4b-02ac-4e28-85ce-03ac71b7051e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:24:51 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b7e64-5908-4e86-8afa-278ef23bd6ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001] added
Aug 09 19:24:51 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8550c844-ba0d-4fd6-9c39-7fec0e3b1622]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a3e6bf-c9a5-4c7c-b3b7-03dc8d59b2a2]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ospZHUBg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ospZHUBg" returned: 0 in 0.076s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[311e60e5-1e6d-460b-b4f8-d3541f5d7f3d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ospZHUBg'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5205915-ade5-44b8-a5ed-f90dec853120]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3db114-c7bc-475f-9d93-2186719b93aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:52 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:52 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a7cc06-f2f7-47cd-822e-d0b6c1ac26d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260]
Aug 09 19:24:52 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:52 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136c8c2-30be-47d4-aae7-c6ddbbed12ec]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[577286d3-e4e5-4aed-8eac-ccef51e6f430]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:52 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:52 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:52 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1aac67-c0e2-4d27-8269-ef1c465f1bc1]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:24:52 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ospZHUBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "710b4ed6-847f-4ff3-b019-d37b94178768" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:53 user nova-compute[72441]: INFO nova.compute.manager [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Terminating instance
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23135333464653831', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135333464653831', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1532187531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1532187531',id=15,image_ref='4d61264f-95a2-4536-8edf-68f362c48bc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-399743535',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-yp85lf82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member',shelved_at='2023-08-09T19:22:44.999759',shelved_host='user',shelved_image_id='4d61264f-95a2-4536-8edf-68f362c48bc3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=9993e22d-c00a-497a-bb28-500abdc8a2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'pci_devices' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:24:53 user nova-compute[72441]:   <uuid>9993e22d-c00a-497a-bb28-500abdc8a2f3</uuid>
Aug 09 19:24:53 user nova-compute[72441]:   <name>instance-0000000f</name>
Aug 09 19:24:53 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:24:53 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:24:53 user nova-compute[72441]:   <metadata>
Aug 09 19:24:53 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:24:53 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:24:53 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1532187531</nova:name>
Aug 09 19:24:53 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:24:51</nova:creationTime>
Aug 09 19:24:53 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:24:53 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:24:53 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:24:53 user nova-compute[72441]:       <nova:owner>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:user uuid="890855d048044ea89e304b9fc38b7600">tempest-AttachVolumeShelveTestJSON-1792449968-project-member</nova:user>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:project uuid="5f8e21260bfe4c228b1f97b1dbb7a049">tempest-AttachVolumeShelveTestJSON-1792449968</nova:project>
Aug 09 19:24:53 user nova-compute[72441]:       </nova:owner>
Aug 09 19:24:53 user nova-compute[72441]:       <nova:root type="image" uuid="4d61264f-95a2-4536-8edf-68f362c48bc3"/>
Aug 09 19:24:53 user nova-compute[72441]:       <nova:ports>
Aug 09 19:24:53 user nova-compute[72441]:         <nova:port uuid="4549fab1-2c9e-42d0-8941-d981d3dee0b7">
Aug 09 19:24:53 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:24:53 user nova-compute[72441]:         </nova:port>
Aug 09 19:24:53 user nova-compute[72441]:       </nova:ports>
Aug 09 19:24:53 user nova-compute[72441]:     </nova:instance>
Aug 09 19:24:53 user nova-compute[72441]:   </metadata>
Aug 09 19:24:53 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:24:53 user nova-compute[72441]:     <system>
Aug 09 19:24:53 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:24:53 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:24:53 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:24:53 user nova-compute[72441]:       <entry name="serial">9993e22d-c00a-497a-bb28-500abdc8a2f3</entry>
Aug 09 19:24:53 user nova-compute[72441]:       <entry name="uuid">9993e22d-c00a-497a-bb28-500abdc8a2f3</entry>
Aug 09 19:24:53 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:24:53 user nova-compute[72441]:     </system>
Aug 09 19:24:53 user nova-compute[72441]:   </sysinfo>
Aug 09 19:24:53 user nova-compute[72441]:   <os>
Aug 09 19:24:53 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:24:53 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:24:53 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:24:53 user nova-compute[72441]:   </os>
Aug 09 19:24:53 user nova-compute[72441]:   <features>
Aug 09 19:24:53 user nova-compute[72441]:     <acpi/>
Aug 09 19:24:53 user nova-compute[72441]:     <apic/>
Aug 09 19:24:53 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:24:53 user nova-compute[72441]:   </features>
Aug 09 19:24:53 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:24:53 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:24:53 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:24:53 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:24:53 user nova-compute[72441]:   </clock>
Aug 09 19:24:53 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:24:53 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:24:53 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:24:53 user nova-compute[72441]:   </cpu>
Aug 09 19:24:53 user nova-compute[72441]:   <devices>
Aug 09 19:24:53 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:24:53 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:24:53 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk"/>
Aug 09 19:24:53 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:24:53 user nova-compute[72441]:     </disk>
Aug 09 19:24:53 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:24:53 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:24:53 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:24:53 user nova-compute[72441]:       <target dev="vdc" bus="virtio"/>
Aug 09 19:24:53 user nova-compute[72441]:       <serial>2f97fa00-be47-4cc2-8a0d-7276726b4001</serial>
Aug 09 19:24:53 user nova-compute[72441]:     </disk>
Aug 09 19:24:53 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:24:53 user nova-compute[72441]:       <mac address="fa:16:3e:b9:ae:39"/>
Aug 09 19:24:53 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:24:53 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:24:53 user nova-compute[72441]:       <target dev="tap4549fab1-2c"/>
Aug 09 19:24:53 user nova-compute[72441]:     </interface>
Aug 09 19:24:53 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:24:53 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/console.log" append="off"/>
Aug 09 19:24:53 user nova-compute[72441]:     </serial>
Aug 09 19:24:53 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:24:53 user nova-compute[72441]:     <video>
Aug 09 19:24:53 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:24:53 user nova-compute[72441]:     </video>
Aug 09 19:24:53 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:24:53 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:24:53 user nova-compute[72441]:     </rng>
Aug 09 19:24:53 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:24:53 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:24:53 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:24:53 user nova-compute[72441]:     </memballoon>
Aug 09 19:24:53 user nova-compute[72441]:   </devices>
Aug 09 19:24:53 user nova-compute[72441]: </domain>
Aug 09 19:24:53 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1532187531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1532187531',id=15,image_ref='4d61264f-95a2-4536-8edf-68f362c48bc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-399743535',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-yp85lf82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member',shelved_at='2023-08-09T19:22:44.999759',shelved_host='user',shelved_image_id='4d61264f-95a2-4536-8edf-68f362c48bc3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=9993e22d-c00a-497a-bb28-500abdc8a2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG os_vif [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4549fab1-2c, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4549fab1-2c, col_values=(('external_ids', {'iface-id': '4549fab1-2c9e-42d0-8941-d981d3dee0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ae:39', 'vm-uuid': '9993e22d-c00a-497a-bb28-500abdc8a2f3'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: INFO os_vif [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c')
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No VIF found with MAC fa:16:3e:b9:ae:39, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-b17733a9-2e58-4035-9f5d-9b874a7c16e7 req-0271c205-e44e-4f80-aaf4-e1d2ccc8bf2b service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b17733a9-2e58-4035-9f5d-9b874a7c16e7 req-0271c205-e44e-4f80-aaf4-e1d2ccc8bf2b service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b17733a9-2e58-4035-9f5d-9b874a7c16e7 req-0271c205-e44e-4f80-aaf4-e1d2ccc8bf2b service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b17733a9-2e58-4035-9f5d-9b874a7c16e7 req-0271c205-e44e-4f80-aaf4-e1d2ccc8bf2b service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-b17733a9-2e58-4035-9f5d-9b874a7c16e7 req-0271c205-e44e-4f80-aaf4-e1d2ccc8bf2b service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-b17733a9-2e58-4035-9f5d-9b874a7c16e7 req-0271c205-e44e-4f80-aaf4-e1d2ccc8bf2b service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-01b94251-e89f-493a-a778-a719e1f89b92 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a120223-f99c-4bae-9893-f96d247fcfca req-780157b1-b0da-45f6-95ef-ac8085f1bbff service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a120223-f99c-4bae-9893-f96d247fcfca req-780157b1-b0da-45f6-95ef-ac8085f1bbff service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a120223-f99c-4bae-9893-f96d247fcfca req-780157b1-b0da-45f6-95ef-ac8085f1bbff service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a120223-f99c-4bae-9893-f96d247fcfca req-780157b1-b0da-45f6-95ef-ac8085f1bbff service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a120223-f99c-4bae-9893-f96d247fcfca req-780157b1-b0da-45f6-95ef-ac8085f1bbff service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a120223-f99c-4bae-9893-f96d247fcfca req-780157b1-b0da-45f6-95ef-ac8085f1bbff service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-e499f150-aff2-4041-b359-c053ad8d904b for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-9e642332-8d24-463a-a152-99a1d7cfe428 req-e0830466-4cd1-49b1-963a-93e40f33a590 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9e642332-8d24-463a-a152-99a1d7cfe428 req-e0830466-4cd1-49b1-963a-93e40f33a590 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9e642332-8d24-463a-a152-99a1d7cfe428 req-e0830466-4cd1-49b1-963a-93e40f33a590 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9e642332-8d24-463a-a152-99a1d7cfe428 req-e0830466-4cd1-49b1-963a-93e40f33a590 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-9e642332-8d24-463a-a152-99a1d7cfe428 req-e0830466-4cd1-49b1-963a-93e40f33a590 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-9e642332-8d24-463a-a152-99a1d7cfe428 req-e0830466-4cd1-49b1-963a-93e40f33a590 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-2eedc865-b597-4cff-bfa2-254ce7b182af for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Instance destroyed successfully.
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lazy-loading 'resources' on Instance uuid 710b4ed6-847f-4ff3-b019-d37b94178768 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b94251-e8, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d8:b3,bridge_name='br-int',has_traffic_filtering=True,id=01b94251-e89f-493a-a778-a719e1f89b92,network=Network(e3d57a8e-b0bc-4130-bda4-a14d484b6661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b94251-e8')
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4893ff1f-46, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:97:ca,bridge_name='br-int',has_traffic_filtering=True,id=4893ff1f-461c-4a00-a5cc-beba6cf2d8b5,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4893ff1f-46')
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-2be8138a-4964-4726-ab17-3de8aae620e4 req-1ec7b59e-53b7-42c9-a6a6-d38ade1e6ccc service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2be8138a-4964-4726-ab17-3de8aae620e4 req-1ec7b59e-53b7-42c9-a6a6-d38ade1e6ccc service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2be8138a-4964-4726-ab17-3de8aae620e4 req-1ec7b59e-53b7-42c9-a6a6-d38ade1e6ccc service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2be8138a-4964-4726-ab17-3de8aae620e4 req-1ec7b59e-53b7-42c9-a6a6-d38ade1e6ccc service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-2be8138a-4964-4726-ab17-3de8aae620e4 req-1ec7b59e-53b7-42c9-a6a6-d38ade1e6ccc service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: WARNING nova.compute.manager [req-2be8138a-4964-4726-ab17-3de8aae620e4 req-1ec7b59e-53b7-42c9-a6a6-d38ade1e6ccc service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-e499f150-aff2-4041-b359-c053ad8d904b for instance with vm_state active and task_state deleting.
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape499f150-af, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: WARNING nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-01b94251-e89f-493a-a778-a719e1f89b92 for instance with vm_state active and task_state deleting.
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: WARNING nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-4893ff1f-461c-4a00-a5cc-beba6cf2d8b5 for instance with vm_state active and task_state deleting.
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-126505f6-c765-45f7-8736-6c1179747ebf for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: WARNING nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-126505f6-c765-45f7-8736-6c1179747ebf for instance with vm_state active and task_state deleting.
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: WARNING nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 for instance with vm_state active and task_state deleting.
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-unplugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-a9d667de-880f-4df5-83aa-30825f1540bf req-e19a1d46-e55b-4f49-9ec4-7c81f931118a service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-unplugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:9a:42,bridge_name='br-int',has_traffic_filtering=True,id=e499f150-aff2-4041-b359-c053ad8d904b,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape499f150-af')
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap126505f6-c7, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:61:ef,bridge_name='br-int',has_traffic_filtering=True,id=126505f6-c765-45f7-8736-6c1179747ebf,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap126505f6-c7')
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4818dc25-e7, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:15,bridge_name='br-int',has_traffic_filtering=True,id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1,network=Network(403bc8b3-1ade-4cc5-9728-6403093a1e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4818dc25-e7')
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "2eedc865-b597-4cff-bfa2-254ce7b182af", "address": "fa:16:3e:06:0f:14", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eedc865-b5", "ovs_interfaceid": "2eedc865-b597-4cff-bfa2-254ce7b182af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eedc865-b5, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0f:14,bridge_name='br-int',has_traffic_filtering=True,id=2eedc865-b597-4cff-bfa2-254ce7b182af,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eedc865-b5')
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2109056246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2109056246',id=22,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1QZRX0T7oLHYxxkI17UbC5Da0T7O2pQtIaDTvyHZJwQrntUXRuCGoMPfEEJ8yloLqczJNfFsoGxwb+Ti6yszBF/X/Y77kGX6M8lllvacxEHJrHZE65P7z2KTRmdSRRHQ==',key_name='tempest-keypair-158551269',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6222d55af7e43ef95ee7eaae1ad0bfb',ramdisk_id='',reservation_id='r-s5mhxtau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-986195262',owner_user_name='tempest-TaggedBootDevicesTest_v242-986195262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce0e33b1955c4cd8a83fe2a673e22948',uuid=710b4ed6-847f-4ff3-b019-d37b94178768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converting VIF {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a1b699f-97, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: INFO os_vif [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e4:7e,bridge_name='br-int',has_traffic_filtering=True,id=1a1b699f-97cb-4c93-8a7b-df502a7262fd,network=Network(9c05f743-fc8e-4b75-a419-db78227d4897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a1b699f-97')
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXubPdMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:56 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f30181-953b-49ac-beac-f1b602592753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[68758e6c-341b-44d3-86ef-74057ecbd815]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa897f9-c421-41cd-9dd4-a6cd3b4fc434]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-349758f2-c3b8-486b-921b-31974ee60533 req-ae2a1b51-6098-4340-95e0-2a1e3aa6c7cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-349758f2-c3b8-486b-921b-31974ee60533 req-ae2a1b51-6098-4340-95e0-2a1e3aa6c7cf service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-349758f2-c3b8-486b-921b-31974ee60533 req-ae2a1b51-6098-4340-95e0-2a1e3aa6c7cf service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-349758f2-c3b8-486b-921b-31974ee60533 req-ae2a1b51-6098-4340-95e0-2a1e3aa6c7cf service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-349758f2-c3b8-486b-921b-31974ee60533 req-ae2a1b51-6098-4340-95e0-2a1e3aa6c7cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:56 user nova-compute[72441]: WARNING nova.compute.manager [req-349758f2-c3b8-486b-921b-31974ee60533 req-ae2a1b51-6098-4340-95e0-2a1e3aa6c7cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-2eedc865-b597-4cff-bfa2-254ce7b182af for instance with vm_state active and task_state deleting.
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.040s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7a2996-33bb-49ed-9ac4-6a903d1e81cd]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb173fd4-17ea-48c9-801f-39e8b31c2eb3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cbe1a9-9fa6-4a64-bf33-9c62bf3a9afa]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08d674-0c2a-4c07-b232-0db423c18233]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe78bcbc-64e1-45c1-b8af-913ea0f7061f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260]
Aug 09 19:24:56 user nova-compute[72441]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427ec71a-5b5a-465f-b266-02fee837549e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced66af-2488-4114-9929-c252c9b6ec8f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== disconnect_volume: return (361ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWZlCvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:56 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842c142-83be-49f4-8bfd-d56b83a23480]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b13b8a-cc79-4443-a98b-00eb74464057]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:56 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbda0fcf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd6ab0-0d30-4263-804a-3f4af453bc95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7ee4e9-dcee-4de5-ba3c-c0267048372a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f409e0a8-e0bb-4d5d-adfb-7faf54aa586d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e87f70b-6279-46a8-b7c5-ae1c9ab164b5]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937c927-40d2-46d0-9ce4-4f62619768b3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --logout" returned: 0 in 0.146s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f486c8e5-6738-4374-a64b-f00219a31078]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260]
Aug 09 19:24:57 user nova-compute[72441]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:57 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70e9730d-d80b-4b84-aa2a-6dcca676845d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18d30e6-0e6f-41f0-9e73-e5a8a259c44e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== disconnect_volume: return (515ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmafQlGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:24:57 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[044c6bf0-332e-4cf2-9826-cbdafde3f7de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00866c2-e2ae-420d-a29a-9cf8c41b09ed]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:57 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:57 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:57 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:24:57 user nova-compute[72441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc (non-flash)
Aug 09 19:24:57 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:24:57 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbda0fcf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db5c9a8-967a-4b22-aa5b-384054032cea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daeb7ae-489f-4312-bce2-7df1ba4fae6a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece2cfe-012b-4650-98b6-aec06d9ab6df]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f90779-aef4-4596-950c-c00c33f769f7]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a19aa-9776-4da4-9749-6914d3048fae]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eefb7ee-e257-4b14-80b3-a13f93047874]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260]
Aug 09 19:24:57 user nova-compute[72441]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc, portal: 172.16.0.220,3260] successful.
Aug 09 19:24:57 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb1f53-2f64-4422-84ef-567e124461fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5551a0-b21b-4b36-a1a0-ea4d23846d92]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] <== disconnect_volume: return (324ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:24:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Deleting instance files /opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768_del
Aug 09 19:24:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Deletion of /opt/stack/data/nova/instances/710b4ed6-847f-4ff3-b019-d37b94178768_del complete
Aug 09 19:24:57 user nova-compute[72441]: INFO nova.compute.manager [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Took 4.43 seconds to destroy the instance on the hypervisor.
Aug 09 19:24:57 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:24:57 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Acquiring lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Lock "710b4ed6-847f-4ff3-b019-d37b94178768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] No waiting events found dispatching network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:58 user nova-compute[72441]: WARNING nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received unexpected event network-vif-plugged-1a1b699f-97cb-4c93-8a7b-df502a7262fd for instance with vm_state active and task_state deleting.
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:58 user nova-compute[72441]: WARNING nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:24:58 user nova-compute[72441]: WARNING nova.compute.manager [req-bd5ee609-0ac5-4199-b1b9-9e29a5c90498 req-e0b437b3-aaad-448f-b2da-473195911273 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609098.5263033, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] VM Resumed (Lifecycle Event)
Aug 09 19:24:58 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance spawned successfully.
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609098.5264826, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:24:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] VM Started (Lifecycle Event)
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:24:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:24:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:24:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57605258-d9f7-4bcf-89d8-32cb192069d5 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.152s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-3ab10215-80ac-4f36-9152-323c76814adb req-01791aa0-d976-4819-b266-5d0a5d2a58cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-deleted-2eedc865-b597-4cff-bfa2-254ce7b182af {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:00 user nova-compute[72441]: INFO nova.compute.manager [req-3ab10215-80ac-4f36-9152-323c76814adb req-01791aa0-d976-4819-b266-5d0a5d2a58cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Neutron deleted interface 2eedc865-b597-4cff-bfa2-254ce7b182af; detaching it from the instance and deleting it from the info cache
Aug 09 19:25:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-3ab10215-80ac-4f36-9152-323c76814adb req-01791aa0-d976-4819-b266-5d0a5d2a58cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "address": "fa:16:3e:a2:e4:7e", "network": {"id": "9c05f743-fc8e-4b75-a419-db78227d4897", "bridge": "br-int", "label": "tempest-device-tagging-net2-712430477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a1b699f-97", "ovs_interfaceid": "1a1b699f-97cb-4c93-8a7b-df502a7262fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-3ab10215-80ac-4f36-9152-323c76814adb req-01791aa0-d976-4819-b266-5d0a5d2a58cf service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Detach interface failed, port_id=2eedc865-b597-4cff-bfa2-254ce7b182af, reason: Instance 710b4ed6-847f-4ff3-b019-d37b94178768 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:25:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-deleted-1a1b699f-97cb-4c93-8a7b-df502a7262fd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:02 user nova-compute[72441]: INFO nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Neutron deleted interface 1a1b699f-97cb-4c93-8a7b-df502a7262fd; detaching it from the instance and deleting it from the info cache
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "address": "fa:16:3e:47:43:15", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4818dc25-e7", "ovs_interfaceid": "4818dc25-e7fc-4e6b-9f61-60f9d69237d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Detach interface failed, port_id=1a1b699f-97cb-4c93-8a7b-df502a7262fd, reason: Instance 710b4ed6-847f-4ff3-b019-d37b94178768 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-deleted-4818dc25-e7fc-4e6b-9f61-60f9d69237d1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:02 user nova-compute[72441]: INFO nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Neutron deleted interface 4818dc25-e7fc-4e6b-9f61-60f9d69237d1; detaching it from the instance and deleting it from the info cache
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "01b94251-e89f-493a-a778-a719e1f89b92", "address": "fa:16:3e:fa:d8:b3", "network": {"id": "e3d57a8e-b0bc-4130-bda4-a14d484b6661", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1192102301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b94251-e8", "ovs_interfaceid": "01b94251-e89f-493a-a778-a719e1f89b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Detach interface failed, port_id=4818dc25-e7fc-4e6b-9f61-60f9d69237d1, reason: Instance 710b4ed6-847f-4ff3-b019-d37b94178768 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-deleted-01b94251-e89f-493a-a778-a719e1f89b92 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:02 user nova-compute[72441]: INFO nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Neutron deleted interface 01b94251-e89f-493a-a778-a719e1f89b92; detaching it from the instance and deleting it from the info cache
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [{"id": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "address": "fa:16:3e:21:97:ca", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4893ff1f-46", "ovs_interfaceid": "4893ff1f-461c-4a00-a5cc-beba6cf2d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e499f150-aff2-4041-b359-c053ad8d904b", "address": "fa:16:3e:64:9a:42", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape499f150-af", "ovs_interfaceid": "e499f150-aff2-4041-b359-c053ad8d904b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "126505f6-c765-45f7-8736-6c1179747ebf", "address": "fa:16:3e:31:61:ef", "network": {"id": "403bc8b3-1ade-4cc5-9728-6403093a1e2e", "bridge": "br-int", "label": "tempest-device-tagging-net1-332088891", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a6222d55af7e43ef95ee7eaae1ad0bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap126505f6-c7", "ovs_interfaceid": "126505f6-c765-45f7-8736-6c1179747ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-2193a394-9b09-407e-b800-999718d4468e req-62908b8f-65d9-4fb9-8ac4-1f032edce3a8 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Detach interface failed, port_id=01b94251-e89f-493a-a778-a719e1f89b92, reason: Instance 710b4ed6-847f-4ff3-b019-d37b94178768 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:25:02 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:02 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Took 4.87 seconds to deallocate network for instance.
Aug 09 19:25:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-90c31fb7-7688-4fb6-ac55-42e68fb6c957 req-ba975dec-9a07-4838-bdf4-0d942c143ed5 service nova] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Received event network-vif-deleted-126505f6-c765-45f7-8736-6c1179747ebf {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:04 user nova-compute[72441]: INFO nova.compute.manager [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Took 2.56 seconds to detach 3 volumes for instance.
Aug 09 19:25:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:05 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:05 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:05 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Deleted allocations for instance 710b4ed6-847f-4ff3-b019-d37b94178768
Aug 09 19:25:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f5eeea20-9a21-427d-b5b7-60f5c0f28481 tempest-TaggedBootDevicesTest_v242-986195262 tempest-TaggedBootDevicesTest_v242-986195262-project-member] Lock "710b4ed6-847f-4ff3-b019-d37b94178768" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.434s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:10 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609095.6845286, 710b4ed6-847f-4ff3-b019-d37b94178768 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:10 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] VM Stopped (Lifecycle Event)
Aug 09 19:25:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e6a1d041-beee-4745-bcd5-33f437345b18 None None] [instance: 710b4ed6-847f-4ff3-b019-d37b94178768] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'flavor' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:11 user nova-compute[72441]: INFO nova.compute.manager [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Attaching volume 57bc1d96-f0e4-4eda-bec5-b51a8582e549 to /dev/vdb
Aug 09 19:25:11 user nova-compute[72441]: DEBUG os_brick.utils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cbf185-ab22-4034-9ddb-39f30ca43b84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e4a810-0945-4512-84e1-829632870f82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3c5aa8-6edf-4053-86df-bcf7ce6a13da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bb2053-7949-4b75-8405-bec5dfbca237]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:25:11 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:25:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b285e7-5a1d-4401-bc6f-3af20679de45]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG os_brick.utils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:25:11 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating existing volume attachment record: 5b4f8325-f946-4e71-a7e2-3f15aa5dad3f {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:25:15 user nova-compute[72441]: INFO nova.compute.claims [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Claim successful on node user
Aug 09 19:25:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:25:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:25:15 user nova-compute[72441]: DEBUG nova.policy [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ba704de696a49258532080173d23fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2820770744df88c94474a2ad02e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:25:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Creating image(s)
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "/opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "/opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "3a6c977fffa73ba88b1a5721ea25673e806d178d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "3a6c977fffa73ba88b1a5721ea25673e806d178d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.part --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG nova.virt.images [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] d0573f7e-8838-47ee-9a0a-eb4d300cbb79 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.part /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Successfully created port: 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.part /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.converted" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "3a6c977fffa73ba88b1a5721ea25673e806d178d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.797s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "3a6c977fffa73ba88b1a5721ea25673e806d178d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "3a6c977fffa73ba88b1a5721ea25673e806d178d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d,backing_fmt=raw /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d,backing_fmt=raw /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk 1073741824" returned: 0 in 0.051s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "3a6c977fffa73ba88b1a5721ea25673e806d178d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Cannot resize image /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'migration_context' on Instance uuid 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Ensure instance console log exists: /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Successfully updated port: 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing instance network info cache due to event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance network_info: |[{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.network.neutron [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Start _get_guest_xml network_info=[{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:25:12Z,direct_url=<?>,disk_format='qcow2',id=d0573f7e-8838-47ee-9a0a-eb4d300cbb79,min_disk=0,min_ram=0,name='tempest-scenario-img--909274307',owner='94c2820770744df88c94474a2ad02e77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:25:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'd0573f7e-8838-47ee-9a0a-eb4d300cbb79'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:25:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:25:12Z,direct_url=<?>,disk_format='qcow2',id=d0573f7e-8838-47ee-9a0a-eb4d300cbb79,min_disk=0,min_ram=0,name='tempest-scenario-img--909274307',owner='94c2820770744df88c94474a2ad02e77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:25:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:25:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-873284158',display_name='tempest-TestMinimumBasicScenario-server-873284158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-873284158',id=24,image_ref='d0573f7e-8838-47ee-9a0a-eb4d300cbb79',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpv0pDL4fjIA5p88JOG0Zko97M6yAbmAO1BzimpNUc3pb4Klio+f0m7s16o72yHpGJYdcvH0zL+P9w7ost77ehBvO7zqMX5fmZALujWviruFV35eMVWp1AaSG1bhijZsQ==',key_name='tempest-TestMinimumBasicScenario-2076058511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-nhqkm4p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d0573f7e-8838-47ee-9a0a-eb4d300cbb79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:16Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=2ee4681e-d00f-47af-8b44-e4f8986b60ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:25:18 user nova-compute[72441]:   <uuid>2ee4681e-d00f-47af-8b44-e4f8986b60ea</uuid>
Aug 09 19:25:18 user nova-compute[72441]:   <name>instance-00000018</name>
Aug 09 19:25:18 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:25:18 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:25:18 user nova-compute[72441]:   <metadata>
Aug 09 19:25:18 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:25:18 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:25:18 user nova-compute[72441]:       <nova:name>tempest-TestMinimumBasicScenario-server-873284158</nova:name>
Aug 09 19:25:18 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:25:17</nova:creationTime>
Aug 09 19:25:18 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:25:18 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:25:18 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:25:18 user nova-compute[72441]:       <nova:owner>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:user uuid="7ba704de696a49258532080173d23fd5">tempest-TestMinimumBasicScenario-2005926422-project-member</nova:user>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:project uuid="94c2820770744df88c94474a2ad02e77">tempest-TestMinimumBasicScenario-2005926422</nova:project>
Aug 09 19:25:18 user nova-compute[72441]:       </nova:owner>
Aug 09 19:25:18 user nova-compute[72441]:       <nova:root type="image" uuid="d0573f7e-8838-47ee-9a0a-eb4d300cbb79"/>
Aug 09 19:25:18 user nova-compute[72441]:       <nova:ports>
Aug 09 19:25:18 user nova-compute[72441]:         <nova:port uuid="457692b8-151c-4048-9fb4-1ff0f6566699">
Aug 09 19:25:18 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:25:18 user nova-compute[72441]:         </nova:port>
Aug 09 19:25:18 user nova-compute[72441]:       </nova:ports>
Aug 09 19:25:18 user nova-compute[72441]:     </nova:instance>
Aug 09 19:25:18 user nova-compute[72441]:   </metadata>
Aug 09 19:25:18 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:25:18 user nova-compute[72441]:     <system>
Aug 09 19:25:18 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:25:18 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:25:18 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:25:18 user nova-compute[72441]:       <entry name="serial">2ee4681e-d00f-47af-8b44-e4f8986b60ea</entry>
Aug 09 19:25:18 user nova-compute[72441]:       <entry name="uuid">2ee4681e-d00f-47af-8b44-e4f8986b60ea</entry>
Aug 09 19:25:18 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:25:18 user nova-compute[72441]:     </system>
Aug 09 19:25:18 user nova-compute[72441]:   </sysinfo>
Aug 09 19:25:18 user nova-compute[72441]:   <os>
Aug 09 19:25:18 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:25:18 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:25:18 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:25:18 user nova-compute[72441]:   </os>
Aug 09 19:25:18 user nova-compute[72441]:   <features>
Aug 09 19:25:18 user nova-compute[72441]:     <acpi/>
Aug 09 19:25:18 user nova-compute[72441]:     <apic/>
Aug 09 19:25:18 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:25:18 user nova-compute[72441]:   </features>
Aug 09 19:25:18 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:25:18 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:25:18 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:25:18 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:25:18 user nova-compute[72441]:   </clock>
Aug 09 19:25:18 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:25:18 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:25:18 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:25:18 user nova-compute[72441]:   </cpu>
Aug 09 19:25:18 user nova-compute[72441]:   <devices>
Aug 09 19:25:18 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:25:18 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:25:18 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk"/>
Aug 09 19:25:18 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:25:18 user nova-compute[72441]:     </disk>
Aug 09 19:25:18 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:25:18 user nova-compute[72441]:       <mac address="fa:16:3e:41:64:4a"/>
Aug 09 19:25:18 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:18 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:25:18 user nova-compute[72441]:       <target dev="tap457692b8-15"/>
Aug 09 19:25:18 user nova-compute[72441]:     </interface>
Aug 09 19:25:18 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:25:18 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/console.log" append="off"/>
Aug 09 19:25:18 user nova-compute[72441]:     </serial>
Aug 09 19:25:18 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:25:18 user nova-compute[72441]:     <video>
Aug 09 19:25:18 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:18 user nova-compute[72441]:     </video>
Aug 09 19:25:18 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:25:18 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:25:18 user nova-compute[72441]:     </rng>
Aug 09 19:25:18 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:25:18 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:25:18 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:25:18 user nova-compute[72441]:     </memballoon>
Aug 09 19:25:18 user nova-compute[72441]:   </devices>
Aug 09 19:25:18 user nova-compute[72441]: </domain>
Aug 09 19:25:18 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-873284158',display_name='tempest-TestMinimumBasicScenario-server-873284158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-873284158',id=24,image_ref='d0573f7e-8838-47ee-9a0a-eb4d300cbb79',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpv0pDL4fjIA5p88JOG0Zko97M6yAbmAO1BzimpNUc3pb4Klio+f0m7s16o72yHpGJYdcvH0zL+P9w7ost77ehBvO7zqMX5fmZALujWviruFV35eMVWp1AaSG1bhijZsQ==',key_name='tempest-TestMinimumBasicScenario-2076058511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-nhqkm4p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d0573f7e-8838-47ee-9a0a-eb4d300cbb79',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:16Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=2ee4681e-d00f-47af-8b44-e4f8986b60ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG os_vif [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457692b8-15, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap457692b8-15, col_values=(('external_ids', {'iface-id': '457692b8-151c-4048-9fb4-1ff0f6566699', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:64:4a', 'vm-uuid': '2ee4681e-d00f-47af-8b44-e4f8986b60ea'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:18 user nova-compute[72441]: INFO os_vif [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15')
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No VIF found with MAC fa:16:3e:41:64:4a, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updated VIF entry in instance network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88e9ba2b-11c8-467c-8681-644bbb4d0e2f req-8806452e-b841-4e57-b561-1262febb6d8a service nova] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:25:19 user nova-compute[72441]: INFO nova.compute.claims [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Claim successful on node user
Aug 09 19:25:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-d6a5064d-ba79-41ae-8eb7-4e0abd27ef54 req-9ba16623-8dcf-4747-a753-9dec30e433bc service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d6a5064d-ba79-41ae-8eb7-4e0abd27ef54 req-9ba16623-8dcf-4747-a753-9dec30e433bc service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d6a5064d-ba79-41ae-8eb7-4e0abd27ef54 req-9ba16623-8dcf-4747-a753-9dec30e433bc service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d6a5064d-ba79-41ae-8eb7-4e0abd27ef54 req-9ba16623-8dcf-4747-a753-9dec30e433bc service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-d6a5064d-ba79-41ae-8eb7-4e0abd27ef54 req-9ba16623-8dcf-4747-a753-9dec30e433bc service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:19 user nova-compute[72441]: WARNING nova.compute.manager [req-d6a5064d-ba79-41ae-8eb7-4e0abd27ef54 req-9ba16623-8dcf-4747-a753-9dec30e433bc service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state building and task_state spawning.
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.network.neutron [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:25:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.policy [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f208845e39d41c5b4a2b76748c8e658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57335007b06a45ad9f91aa03555d5428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:25:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Creating image(s)
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk 1073741824" returned: 0 in 0.075s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:25:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Cannot resize image /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'migration_context' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Ensure instance console log exists: /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.network.neutron [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Successfully created port: f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:25:21 user nova-compute[72441]: INFO nova.compute.claims [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Claim successful on node user
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:25:21 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:25:21 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:25:21 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a5bd9a-90be-4786-aacd-4408caad4b36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:25:21 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe9271e-0ac4-4fb9-a855-8efa721204dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549] added
Aug 09 19:25:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c074d1e-82c1-442b-85d0-9dd1d49435da]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58edf143-a549-46a4-85ff-356d923c9f2b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heCywOBM {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heCywOBM" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f73a579-3e91-4b56-8417-673129a06ce6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heCywOBM'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00db3f-e9a5-4cc0-81f0-3c65e352f3b9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89473ac6-116d-49f9-8b12-7e5cd65d3046]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b4812-90f4-4fa9-9dd6-024d705ca6b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]
Aug 09 19:25:21 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.
Aug 09 19:25:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4da328a-f61b-4f50-b125-378fdfaea525]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1905fa-0c6c-400c-b975-c23abf00956f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:25:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3cbf01-c549-471a-bc2d-2286bbe1f7c4]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:21 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609122.0235786, 2ee4681e-d00f-47af-8b44-e4f8986b60ea => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] VM Resumed (Lifecycle Event)
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-643d88ed-f41a-4055-839f-753289b0ac48 req-f8fba82c-5020-4338-b29c-9e2a69f1378b service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-643d88ed-f41a-4055-839f-753289b0ac48 req-f8fba82c-5020-4338-b29c-9e2a69f1378b service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-643d88ed-f41a-4055-839f-753289b0ac48 req-f8fba82c-5020-4338-b29c-9e2a69f1378b service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-643d88ed-f41a-4055-839f-753289b0ac48 req-f8fba82c-5020-4338-b29c-9e2a69f1378b service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-643d88ed-f41a-4055-839f-753289b0ac48 req-f8fba82c-5020-4338-b29c-9e2a69f1378b service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:22 user nova-compute[72441]: WARNING nova.compute.manager [req-643d88ed-f41a-4055-839f-753289b0ac48 req-f8fba82c-5020-4338-b29c-9e2a69f1378b service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state building and task_state spawning.
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance spawned successfully.
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609122.023805, 2ee4681e-d00f-47af-8b44-e4f8986b60ea => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] VM Started (Lifecycle Event)
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Successfully updated port: f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquired lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-changed-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Refreshing instance network info cache due to event network-changed-f88a4415-bd67-4929-be84-66c1fdee068e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] Acquiring lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.policy [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95cede1cc2549dfb6c82d2baeaaf39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1c396deeca4c219140761e4bd8141d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Took 7.06 seconds to build instance.
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ff8e727-05f8-4736-81bd-631f315a2905 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.168s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:25:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Creating image(s)
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "/opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "/opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "/opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Releasing lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Instance network_info: |[{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] Acquired lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Refreshing network info cache for port f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Start _get_guest_xml network_info=[{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk 1073741824" returned: 0 in 0.063s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23661376335383666', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661376335383666', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.objects.instance [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'flavor' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:22 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:22 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'pci_devices' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:25:22 user nova-compute[72441]:   <uuid>f0c45570-1b41-4666-9fe0-ed489926132b</uuid>
Aug 09 19:25:22 user nova-compute[72441]:   <name>instance-00000019</name>
Aug 09 19:25:22 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:25:22 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:25:22 user nova-compute[72441]:   <metadata>
Aug 09 19:25:22 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:25:22 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:25:22 user nova-compute[72441]:       <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:25:22 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:25:22</nova:creationTime>
Aug 09 19:25:22 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:25:22 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:25:22 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:25:22 user nova-compute[72441]:       <nova:owner>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:25:22 user nova-compute[72441]:       </nova:owner>
Aug 09 19:25:22 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:25:22 user nova-compute[72441]:       <nova:ports>
Aug 09 19:25:22 user nova-compute[72441]:         <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:25:22 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:25:22 user nova-compute[72441]:         </nova:port>
Aug 09 19:25:22 user nova-compute[72441]:       </nova:ports>
Aug 09 19:25:22 user nova-compute[72441]:     </nova:instance>
Aug 09 19:25:22 user nova-compute[72441]:   </metadata>
Aug 09 19:25:22 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:25:22 user nova-compute[72441]:     <system>
Aug 09 19:25:22 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:25:22 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:25:22 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:25:22 user nova-compute[72441]:       <entry name="serial">f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:25:22 user nova-compute[72441]:       <entry name="uuid">f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:25:22 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:25:22 user nova-compute[72441]:     </system>
Aug 09 19:25:22 user nova-compute[72441]:   </sysinfo>
Aug 09 19:25:22 user nova-compute[72441]:   <os>
Aug 09 19:25:22 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:25:22 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:25:22 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:25:22 user nova-compute[72441]:   </os>
Aug 09 19:25:22 user nova-compute[72441]:   <features>
Aug 09 19:25:22 user nova-compute[72441]:     <acpi/>
Aug 09 19:25:22 user nova-compute[72441]:     <apic/>
Aug 09 19:25:22 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:25:22 user nova-compute[72441]:   </features>
Aug 09 19:25:22 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:25:22 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:25:22 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:25:22 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:25:22 user nova-compute[72441]:   </clock>
Aug 09 19:25:22 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:25:22 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:25:22 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:25:22 user nova-compute[72441]:   </cpu>
Aug 09 19:25:22 user nova-compute[72441]:   <devices>
Aug 09 19:25:22 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:25:22 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:25:22 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk"/>
Aug 09 19:25:22 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:25:22 user nova-compute[72441]:     </disk>
Aug 09 19:25:22 user nova-compute[72441]:     <disk type="file" device="cdrom">
Aug 09 19:25:22 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 19:25:22 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config"/>
Aug 09 19:25:22 user nova-compute[72441]:       <target dev="hda" bus="ide"/>
Aug 09 19:25:22 user nova-compute[72441]:     </disk>
Aug 09 19:25:22 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:25:22 user nova-compute[72441]:       <mac address="fa:16:3e:d4:a5:a9"/>
Aug 09 19:25:22 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:22 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:25:22 user nova-compute[72441]:       <target dev="tapf88a4415-bd"/>
Aug 09 19:25:22 user nova-compute[72441]:     </interface>
Aug 09 19:25:22 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:25:22 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log" append="off"/>
Aug 09 19:25:22 user nova-compute[72441]:     </serial>
Aug 09 19:25:22 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:25:22 user nova-compute[72441]:     <video>
Aug 09 19:25:22 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:22 user nova-compute[72441]:     </video>
Aug 09 19:25:22 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:25:22 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:25:22 user nova-compute[72441]:     </rng>
Aug 09 19:25:22 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:25:22 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:25:22 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:25:22 user nova-compute[72441]:     </memballoon>
Aug 09 19:25:22 user nova-compute[72441]:   </devices>
Aug 09 19:25:22 user nova-compute[72441]: </domain>
Aug 09 19:25:22 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG os_vif [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Successfully created port: 89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:25:22 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:25:22 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:25:22 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:25:22 user nova-compute[72441]:   <serial>57bc1d96-f0e4-4eda-bec5-b51a8582e549</serial>
Aug 09 19:25:22 user nova-compute[72441]: </disk>
Aug 09 19:25:22 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf88a4415-bd, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf88a4415-bd, col_values=(('external_ids', {'iface-id': 'f88a4415-bd67-4929-be84-66c1fdee068e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:a5:a9', 'vm-uuid': 'f0c45570-1b41-4666-9fe0-ed489926132b'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:23 user nova-compute[72441]: INFO os_vif [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd')
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Cannot resize image /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lazy-loading 'migration_context' on Instance uuid 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Ensure instance console log exists: /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No BDM found with device name hda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No VIF found with MAC fa:16:3e:d4:a5:a9, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:25:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Using config drive
Aug 09 19:25:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Creating config drive at /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprl8vurg8 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprl8vurg8" returned: 0 in 0.066s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updated VIF entry in instance network info cache for port f88a4415-bd67-4929-be84-66c1fdee068e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b569dd43-66cd-4d48-b462-9eda9d2f4efd req-f62418cb-7552-42d8-a280-869aa7fbcf0c service nova] Releasing lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No VIF found with MAC fa:16:3e:d6:d5:a3, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-11d0d250-cfaa-424f-a192-5abe0cf32f6f tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.185s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:23 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Successfully updated port: 89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "refresh_cache-35cf4c2d-73eb-4973-8fe7-49de92ff46c4" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquired lock "refresh_cache-35cf4c2d-73eb-4973-8fe7-49de92ff46c4" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received event network-changed-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Refreshing instance network info cache due to event network-changed-89f27d0f-fe9c-4ec2-9361-25acbd89c290. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] Acquiring lock "refresh_cache-35cf4c2d-73eb-4973-8fe7-49de92ff46c4" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Updating instance_info_cache with network_info: [{"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Releasing lock "refresh_cache-35cf4c2d-73eb-4973-8fe7-49de92ff46c4" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Instance network_info: |[{"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] Acquired lock "refresh_cache-35cf4c2d-73eb-4973-8fe7-49de92ff46c4" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.neutron [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Refreshing network info cache for port 89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Start _get_guest_xml network_info=[{"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:24 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:24 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1562489233',display_name='tempest-VolumesActionsTest-instance-1562489233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1562489233',id=26,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1c396deeca4c219140761e4bd8141d',ramdisk_id='',reservation_id='r-fyxm6k1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-57443595',owner_user_name='tempest-VolumesActionsTest-57443595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:22Z,user_data=None,user_id='e95cede1cc2549dfb6c82d2baeaaf39a',uuid=35cf4c2d-73eb-4973-8fe7-49de92ff46c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converting VIF {"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lazy-loading 'pci_devices' on Instance uuid 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:25:24 user nova-compute[72441]:   <uuid>35cf4c2d-73eb-4973-8fe7-49de92ff46c4</uuid>
Aug 09 19:25:24 user nova-compute[72441]:   <name>instance-0000001a</name>
Aug 09 19:25:24 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:25:24 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:25:24 user nova-compute[72441]:   <metadata>
Aug 09 19:25:24 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:25:24 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:25:24 user nova-compute[72441]:       <nova:name>tempest-VolumesActionsTest-instance-1562489233</nova:name>
Aug 09 19:25:24 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:25:24</nova:creationTime>
Aug 09 19:25:24 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:25:24 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:25:24 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:25:24 user nova-compute[72441]:       <nova:owner>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:user uuid="e95cede1cc2549dfb6c82d2baeaaf39a">tempest-VolumesActionsTest-57443595-project-member</nova:user>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:project uuid="cd1c396deeca4c219140761e4bd8141d">tempest-VolumesActionsTest-57443595</nova:project>
Aug 09 19:25:24 user nova-compute[72441]:       </nova:owner>
Aug 09 19:25:24 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:25:24 user nova-compute[72441]:       <nova:ports>
Aug 09 19:25:24 user nova-compute[72441]:         <nova:port uuid="89f27d0f-fe9c-4ec2-9361-25acbd89c290">
Aug 09 19:25:24 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:25:24 user nova-compute[72441]:         </nova:port>
Aug 09 19:25:24 user nova-compute[72441]:       </nova:ports>
Aug 09 19:25:24 user nova-compute[72441]:     </nova:instance>
Aug 09 19:25:24 user nova-compute[72441]:   </metadata>
Aug 09 19:25:24 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:25:24 user nova-compute[72441]:     <system>
Aug 09 19:25:24 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:25:24 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:25:24 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:25:24 user nova-compute[72441]:       <entry name="serial">35cf4c2d-73eb-4973-8fe7-49de92ff46c4</entry>
Aug 09 19:25:24 user nova-compute[72441]:       <entry name="uuid">35cf4c2d-73eb-4973-8fe7-49de92ff46c4</entry>
Aug 09 19:25:24 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:25:24 user nova-compute[72441]:     </system>
Aug 09 19:25:24 user nova-compute[72441]:   </sysinfo>
Aug 09 19:25:24 user nova-compute[72441]:   <os>
Aug 09 19:25:24 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:25:24 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:25:24 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:25:24 user nova-compute[72441]:   </os>
Aug 09 19:25:24 user nova-compute[72441]:   <features>
Aug 09 19:25:24 user nova-compute[72441]:     <acpi/>
Aug 09 19:25:24 user nova-compute[72441]:     <apic/>
Aug 09 19:25:24 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:25:24 user nova-compute[72441]:   </features>
Aug 09 19:25:24 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:25:24 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:25:24 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:25:24 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:25:24 user nova-compute[72441]:   </clock>
Aug 09 19:25:24 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:25:24 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:25:24 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:25:24 user nova-compute[72441]:   </cpu>
Aug 09 19:25:24 user nova-compute[72441]:   <devices>
Aug 09 19:25:24 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:25:24 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:25:24 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk"/>
Aug 09 19:25:24 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:25:24 user nova-compute[72441]:     </disk>
Aug 09 19:25:24 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:25:24 user nova-compute[72441]:       <mac address="fa:16:3e:29:35:16"/>
Aug 09 19:25:24 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:24 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:25:24 user nova-compute[72441]:       <target dev="tap89f27d0f-fe"/>
Aug 09 19:25:24 user nova-compute[72441]:     </interface>
Aug 09 19:25:24 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:25:24 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/console.log" append="off"/>
Aug 09 19:25:24 user nova-compute[72441]:     </serial>
Aug 09 19:25:24 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:25:24 user nova-compute[72441]:     <video>
Aug 09 19:25:24 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:24 user nova-compute[72441]:     </video>
Aug 09 19:25:24 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:25:24 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:25:24 user nova-compute[72441]:     </rng>
Aug 09 19:25:24 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:25:24 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:25:24 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:25:24 user nova-compute[72441]:     </memballoon>
Aug 09 19:25:24 user nova-compute[72441]:   </devices>
Aug 09 19:25:24 user nova-compute[72441]: </domain>
Aug 09 19:25:24 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1562489233',display_name='tempest-VolumesActionsTest-instance-1562489233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1562489233',id=26,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1c396deeca4c219140761e4bd8141d',ramdisk_id='',reservation_id='r-fyxm6k1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-57443595',owner_user_name='tempest-VolumesActionsTest-57443595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:22Z,user_data=None,user_id='e95cede1cc2549dfb6c82d2baeaaf39a',uuid=35cf4c2d-73eb-4973-8fe7-49de92ff46c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converting VIF {"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG os_vif [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89f27d0f-fe, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89f27d0f-fe, col_values=(('external_ids', {'iface-id': '89f27d0f-fe9c-4ec2-9361-25acbd89c290', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:35:16', 'vm-uuid': '35cf4c2d-73eb-4973-8fe7-49de92ff46c4'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: INFO os_vif [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe')
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] No VIF found with MAC fa:16:3e:29:35:16, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-e5bb5ca3-4347-4d6b-b223-6747876f0343 req-66790618-212f-4858-8281-5560b4f25468 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e5bb5ca3-4347-4d6b-b223-6747876f0343 req-66790618-212f-4858-8281-5560b4f25468 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e5bb5ca3-4347-4d6b-b223-6747876f0343 req-66790618-212f-4858-8281-5560b4f25468 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e5bb5ca3-4347-4d6b-b223-6747876f0343 req-66790618-212f-4858-8281-5560b4f25468 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-e5bb5ca3-4347-4d6b-b223-6747876f0343 req-66790618-212f-4858-8281-5560b4f25468 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:25 user nova-compute[72441]: WARNING nova.compute.manager [req-e5bb5ca3-4347-4d6b-b223-6747876f0343 req-66790618-212f-4858-8281-5560b4f25468 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state building and task_state spawning.
Aug 09 19:25:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Updated VIF entry in instance network info cache for port 89f27d0f-fe9c-4ec2-9361-25acbd89c290. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Updating instance_info_cache with network_info: [{"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-48390a04-11c1-44ab-b8fa-65a93a72c048 req-d5a0c3b7-80ff-4301-a062-e1a94e310749 service nova] Releasing lock "refresh_cache-35cf4c2d-73eb-4973-8fe7-49de92ff46c4" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Stashing vm_state: active {{(pid=72441) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'pci_requests' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:25:26 user nova-compute[72441]: INFO nova.compute.claims [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Claim successful on node user
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'resources' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'pci_devices' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:26 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating resource usage from migration 74640d4e-4dcf-4aec-912f-32627fc4d57f
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-54cd47a9-b062-4def-aa30-ff20bd38b125 req-21109515-aab1-4478-b28b-3f14c69abf00 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received event network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54cd47a9-b062-4def-aa30-ff20bd38b125 req-21109515-aab1-4478-b28b-3f14c69abf00 service nova] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54cd47a9-b062-4def-aa30-ff20bd38b125 req-21109515-aab1-4478-b28b-3f14c69abf00 service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54cd47a9-b062-4def-aa30-ff20bd38b125 req-21109515-aab1-4478-b28b-3f14c69abf00 service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-54cd47a9-b062-4def-aa30-ff20bd38b125 req-21109515-aab1-4478-b28b-3f14c69abf00 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] No waiting events found dispatching network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:26 user nova-compute[72441]: WARNING nova.compute.manager [req-54cd47a9-b062-4def-aa30-ff20bd38b125 req-21109515-aab1-4478-b28b-3f14c69abf00 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received unexpected event network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 for instance with vm_state building and task_state spawning.
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:26 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.718s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:27 user nova-compute[72441]: INFO nova.compute.manager [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Migrating
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:27 user nova-compute[72441]: INFO nova.compute.rpcapi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-c9c2ce53-7bae-48b6-8cbe-db1277ad204f req-2bf7d6a4-d69e-41d6-a775-67ab45ef69d3 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c9c2ce53-7bae-48b6-8cbe-db1277ad204f req-2bf7d6a4-d69e-41d6-a775-67ab45ef69d3 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c9c2ce53-7bae-48b6-8cbe-db1277ad204f req-2bf7d6a4-d69e-41d6-a775-67ab45ef69d3 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c9c2ce53-7bae-48b6-8cbe-db1277ad204f req-2bf7d6a4-d69e-41d6-a775-67ab45ef69d3 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-c9c2ce53-7bae-48b6-8cbe-db1277ad204f req-2bf7d6a4-d69e-41d6-a775-67ab45ef69d3 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:27 user nova-compute[72441]: WARNING nova.compute.manager [req-c9c2ce53-7bae-48b6-8cbe-db1277ad204f req-2bf7d6a4-d69e-41d6-a775-67ab45ef69d3 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state building and task_state spawning.
Aug 09 19:25:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Starting migrate_disk_and_power_off {{(pid=72441) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609128.617888, f0c45570-1b41-4666-9fe0-ed489926132b => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] VM Resumed (Lifecycle Event)
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Instance spawned successfully.
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609128.618848, f0c45570-1b41-4666-9fe0-ed489926132b => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] VM Started (Lifecycle Event)
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Took 8.40 seconds to spawn the instance on the hypervisor.
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:28 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance destroyed successfully.
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG os_vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cacd5ec-a1, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received event network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] No waiting events found dispatching network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:29 user nova-compute[72441]: WARNING nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received unexpected event network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 for instance with vm_state building and task_state spawning.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:29 user nova-compute[72441]: WARNING nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_migrating.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:29 user nova-compute[72441]: WARNING nova.compute.manager [req-34a8259a-9bb5-4158-a9e4-6967e39824e1 req-34502765-9879-44f3-90cb-e5f2468c565e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_migrating.
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Took 9.58 seconds to build instance.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e485f9ca-183a-43a5-b03f-9218a55a96a9 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.683s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:29 user nova-compute[72441]: INFO os_vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1')
Aug 09 19:25:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:25:29 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c79289-3c99-4005-8bbf-d16c9c217115]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609129.2803257, 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] VM Resumed (Lifecycle Event)
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de90e14d-e740-4db6-b98c-dd78905351fd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:29 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:29 user nova-compute[72441]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:25:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:29 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:29 user nova-compute[72441]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:25:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984d49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Instance spawned successfully.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b447c0-7c19-4c94-b8ef-0e3746d05450]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609129.2943351, 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] VM Started (Lifecycle Event)
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f066c-f99e-4636-921e-0c1e39113911]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7eade0-fc28-4657-b905-ef22620b104c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3709e-0e46-460c-8216-ca734bfd08c9]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76145f66-893c-4b74-bdb1-d80d3b7e6c5f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Took 7.23 seconds to spawn the instance on the hypervisor.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b614b3-aaa2-4f63-8631-1eb341c40f6a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]
Aug 09 19:25:29 user nova-compute[72441]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.
Aug 09 19:25:29 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd45d11-f851-4198-bc85-456d980d0427]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.581s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== disconnect_volume: return (584ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:25:29 user nova-compute[72441]: INFO nova.compute.manager [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Took 8.35 seconds to build instance.
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ac954df4-4cf1-4b66-b50b-1d7c305b6239 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.541s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c_resize/disk /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "cp -r /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c_resize/disk /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk" returned: 0 in 0.330s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c_resize/disk.info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk.info {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "cp -r /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c_resize/disk.info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk.info" returned: 0 in 0.038s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:31 user nova-compute[72441]: WARNING nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_migrating.
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:31 user nova-compute[72441]: WARNING nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_migrating.
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:31 user nova-compute[72441]: WARNING nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_migrating.
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:31 user nova-compute[72441]: WARNING nova.compute.manager [req-50b639bb-c141-434e-bab5-caa37b518499 req-ab9864b1-4222-47c3-b28e-89698850dd90 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_migrating.
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Port 2cacd5ec-a169-42d7-b356-5878fa2373ed binding to destination host user is already ACTIVE {{(pid=72441) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG os_brick.utils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c951d383-c8ad-412b-ae2d-d5ac4e1a6d56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be684b4b-d120-4e1d-a777-b65baf2cb0af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473b81a-9008-4f97-85c7-d9370a520f91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd184192-f258-4c00-a759-e6329f708dc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:25:33 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0bb9bb-e2f6-40cc-8431-ee4f12acabf3]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG os_brick.utils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:33 user nova-compute[72441]: INFO nova.compute.manager [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Terminating instance
Aug 09 19:25:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc7dfdf1-0d30-4710-ab16-3216221c77df req-eef6714b-d085-48b0-ad77-89ae2c11b60e service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-unplugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc7dfdf1-0d30-4710-ab16-3216221c77df req-eef6714b-d085-48b0-ad77-89ae2c11b60e service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc7dfdf1-0d30-4710-ab16-3216221c77df req-eef6714b-d085-48b0-ad77-89ae2c11b60e service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc7dfdf1-0d30-4710-ab16-3216221c77df req-eef6714b-d085-48b0-ad77-89ae2c11b60e service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc7dfdf1-0d30-4710-ab16-3216221c77df req-eef6714b-d085-48b0-ad77-89ae2c11b60e service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-unplugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc7dfdf1-0d30-4710-ab16-3216221c77df req-eef6714b-d085-48b0-ad77-89ae2c11b60e service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-unplugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:25:34 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:34 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.275619506835938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Instance destroyed successfully.
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lazy-loading 'resources' on Instance uuid 6af57e2e-ad59-4567-956f-1547e9b97abb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-466246566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4662465',id=18,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkM6ow9DIPWJjnO/+aZhGd+lTj9TenNX+F8x18qbfUQn3f2x6+nfme32t+XtJ0fpyWe/woODCbBXPVev89fyHxC+REf2qjjVOSZySluAqtoNJVb5WA4VU0oCWLqYctFlg==',key_name='tempest-keypair-1838124240',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec64589b70774f168e322237f4ba8f02',ramdisk_id='',reservation_id='r-3xo4nywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1787039980',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f8d8970681147f0b260536a1ae85cce',uuid=6af57e2e-ad59-4567-956f-1547e9b97abb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Converting VIF {"id": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "address": "fa:16:3e:ae:13:ed", "network": {"id": "923167bd-5d8f-4a68-905b-6e574c3e83d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1988484591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec64589b70774f168e322237f4ba8f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ceddd5e-f7", "ovs_interfaceid": "7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG os_vif [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ceddd5e-f7, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:34 user nova-compute[72441]: INFO os_vif [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:13:ed,bridge_name='br-int',has_traffic_filtering=True,id=7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109,network=Network(923167bd-5d8f-4a68-905b-6e574c3e83d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ceddd5e-f7')
Aug 09 19:25:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Deleting instance files /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb_del
Aug 09 19:25:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Deletion of /opt/stack/data/nova/instances/6af57e2e-ad59-4567-956f-1547e9b97abb_del complete
Aug 09 19:25:35 user nova-compute[72441]: INFO nova.compute.manager [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 09 19:25:35 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Applying migration context for instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c as it has an incoming, in-progress migration 74640d4e-4dcf-4aec-912f-32627fc4d57f. Migration status is post-migrating {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 19:25:35 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating resource usage from migration 74640d4e-4dcf-4aec-912f-32627fc4d57f
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6af57e2e-ad59-4567-956f-1547e9b97abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance f0c45570-1b41-4666-9fe0-ed489926132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Migration 74640d4e-4dcf-4aec-912f-32627fc4d57f is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:25:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:36 user nova-compute[72441]: WARNING nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received unexpected event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with vm_state active and task_state deleting.
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:36 user nova-compute[72441]: WARNING nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received unexpected event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with vm_state active and task_state deleting.
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:36 user nova-compute[72441]: WARNING nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received unexpected event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with vm_state active and task_state deleting.
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-unplugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-unplugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-unplugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Acquiring lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] No waiting events found dispatching network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:36 user nova-compute[72441]: WARNING nova.compute.manager [req-88d8682e-0642-4ca8-8538-557d906218e9 req-c821a8d6-183c-4f34-9be6-2291c09e3b72 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received unexpected event network-vif-plugged-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 for instance with vm_state active and task_state deleting.
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:36 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Took 1.15 seconds to deallocate network for instance.
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [req-2bb88783-9f7e-4ade-8fa6-d288ff30dc89 req-627cb5f7-cbbe-4894-92f3-bed26305dd16 service nova] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Received event network-vif-deleted-7ceddd5e-f7c5-44e5-bc13-65fdc7bf0109 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:36 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Deleted allocations for instance 6af57e2e-ad59-4567-956f-1547e9b97abb
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:25:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ef810ae4-daf2-41c4-bc5a-e12e66e1994e tempest-TestServerVolumeAttachScenarioOldVersion-1787039980 tempest-TestServerVolumeAttachScenarioOldVersion-1787039980-project-member] Lock "6af57e2e-ad59-4567-956f-1547e9b97abb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:37 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:25:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Starting finish_migration {{(pid=72441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:25:43 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Creating image(s)
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.158s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk. size=21474836480 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609128.8734682, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:43 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Stopped (Lifecycle Event)
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a429bef-5b26-4e4d-8475-ff49e1915b2e None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4a429bef-5b26-4e4d-8475-ff49e1915b2e None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:43 user nova-compute[72441]: INFO nova.compute.manager [None req-4a429bef-5b26-4e4d-8475-ff49e1915b2e None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 19:25:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk 21474836480 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk 21474836480" returned: 0 in 0.048s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Ensure instance console log exists: /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start _get_guest_xml network_info=[{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c', 'attached_at': '2023-08-09T19:25:43.000000', 'detached_at': '', 'volume_id': '57bc1d96-f0e4-4eda-bec5-b51a8582e549', 'serial': '57bc1d96-f0e4-4eda-bec5-b51a8582e549'}, 'attachment_id': 'fdbe919f-68c2-4cea-90e4-e3b8af25008e', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:25:44 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:44 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:25:44 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:25:44 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:25:44 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5feae22-d705-4d19-b133-fdd9a830616d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:25:44 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d3a4a6-0095-4c34-b085-1806d936c8b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549] added
Aug 09 19:25:44 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a018c6-e647-4bfb-855d-b71b5e24b5e8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4095c6-faa5-4832-95a2-0f6c3ab5350f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heCywOBM {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heCywOBM" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33afa0-56c8-471e-81ab-76ab87420c5e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heCywOBM'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5127cb-30ce-4c78-9b1a-0ffd7516ca34]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45fa92-316c-4938-a9a7-b7e7854b6947]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --login" returned: 0 in 0.144s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6802e-a1c4-436f-bca3-57e88ba542a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]
Aug 09 19:25:44 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.
Aug 09 19:25:44 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea892525-75b4-4ffb-a280-d1a1ad6a0407]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286b755-094a-48d2-8a63-46098e84f3b2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:25:44 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf25753-4bc7-4f4c-b683-9af313e84321]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:25:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23661376335383666', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661376335383666', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:25:45 user nova-compute[72441]:   <uuid>33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</uuid>
Aug 09 19:25:45 user nova-compute[72441]:   <name>instance-00000011</name>
Aug 09 19:25:45 user nova-compute[72441]:   <memory>2097152</memory>
Aug 09 19:25:45 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:25:45 user nova-compute[72441]:   <metadata>
Aug 09 19:25:45 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:25:45 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:25:45 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherB-server-744398493</nova:name>
Aug 09 19:25:45 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:25:44</nova:creationTime>
Aug 09 19:25:45 user nova-compute[72441]:       <nova:flavor name="m1.small">
Aug 09 19:25:45 user nova-compute[72441]:         <nova:memory>2048</nova:memory>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:disk>20</nova:disk>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:25:45 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:25:45 user nova-compute[72441]:       <nova:owner>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:user uuid="de57b5e4f9f54fffa53d91f9a6afd092">tempest-ServerActionsTestOtherB-804828463-project-member</nova:user>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:project uuid="4468899cba1a4bfe8a68af07b58b0a04">tempest-ServerActionsTestOtherB-804828463</nova:project>
Aug 09 19:25:45 user nova-compute[72441]:       </nova:owner>
Aug 09 19:25:45 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:25:45 user nova-compute[72441]:       <nova:ports>
Aug 09 19:25:45 user nova-compute[72441]:         <nova:port uuid="2cacd5ec-a169-42d7-b356-5878fa2373ed">
Aug 09 19:25:45 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 19:25:45 user nova-compute[72441]:         </nova:port>
Aug 09 19:25:45 user nova-compute[72441]:       </nova:ports>
Aug 09 19:25:45 user nova-compute[72441]:     </nova:instance>
Aug 09 19:25:45 user nova-compute[72441]:   </metadata>
Aug 09 19:25:45 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:25:45 user nova-compute[72441]:     <system>
Aug 09 19:25:45 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:25:45 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:25:45 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:25:45 user nova-compute[72441]:       <entry name="serial">33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</entry>
Aug 09 19:25:45 user nova-compute[72441]:       <entry name="uuid">33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</entry>
Aug 09 19:25:45 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:25:45 user nova-compute[72441]:     </system>
Aug 09 19:25:45 user nova-compute[72441]:   </sysinfo>
Aug 09 19:25:45 user nova-compute[72441]:   <os>
Aug 09 19:25:45 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:25:45 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:25:45 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:25:45 user nova-compute[72441]:   </os>
Aug 09 19:25:45 user nova-compute[72441]:   <features>
Aug 09 19:25:45 user nova-compute[72441]:     <acpi/>
Aug 09 19:25:45 user nova-compute[72441]:     <apic/>
Aug 09 19:25:45 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:25:45 user nova-compute[72441]:   </features>
Aug 09 19:25:45 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:25:45 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:25:45 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:25:45 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:25:45 user nova-compute[72441]:   </clock>
Aug 09 19:25:45 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:25:45 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:25:45 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:25:45 user nova-compute[72441]:   </cpu>
Aug 09 19:25:45 user nova-compute[72441]:   <devices>
Aug 09 19:25:45 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:25:45 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:25:45 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk"/>
Aug 09 19:25:45 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:25:45 user nova-compute[72441]:     </disk>
Aug 09 19:25:45 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:25:45 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:25:45 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:25:45 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:25:45 user nova-compute[72441]:       <serial>57bc1d96-f0e4-4eda-bec5-b51a8582e549</serial>
Aug 09 19:25:45 user nova-compute[72441]:     </disk>
Aug 09 19:25:45 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:25:45 user nova-compute[72441]:       <mac address="fa:16:3e:d6:d5:a3"/>
Aug 09 19:25:45 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:45 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:25:45 user nova-compute[72441]:       <target dev="tap2cacd5ec-a1"/>
Aug 09 19:25:45 user nova-compute[72441]:     </interface>
Aug 09 19:25:45 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:25:45 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/console.log" append="off"/>
Aug 09 19:25:45 user nova-compute[72441]:     </serial>
Aug 09 19:25:45 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:25:45 user nova-compute[72441]:     <video>
Aug 09 19:25:45 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:25:45 user nova-compute[72441]:     </video>
Aug 09 19:25:45 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:25:45 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:25:45 user nova-compute[72441]:     </rng>
Aug 09 19:25:45 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:25:45 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:25:45 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:25:45 user nova-compute[72441]:     </memballoon>
Aug 09 19:25:45 user nova-compute[72441]:   </devices>
Aug 09 19:25:45 user nova-compute[72441]: </domain>
Aug 09 19:25:45 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2087673283-network", "vif_mac": "fa:16:3e:d6:d5:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG os_vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cacd5ec-a1, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cacd5ec-a1, col_values=(('external_ids', {'iface-id': '2cacd5ec-a169-42d7-b356-5878fa2373ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d5:a3', 'vm-uuid': '33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:45 user nova-compute[72441]: INFO os_vif [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1')
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:25:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] No VIF found with MAC fa:16:3e:d6:d5:a3, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-b5028c59-75c6-4f22-9e3f-c8084c0b693b req-de445cdb-69ab-4856-9981-1ac3af305774 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b5028c59-75c6-4f22-9e3f-c8084c0b693b req-de445cdb-69ab-4856-9981-1ac3af305774 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b5028c59-75c6-4f22-9e3f-c8084c0b693b req-de445cdb-69ab-4856-9981-1ac3af305774 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b5028c59-75c6-4f22-9e3f-c8084c0b693b req-de445cdb-69ab-4856-9981-1ac3af305774 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-b5028c59-75c6-4f22-9e3f-c8084c0b693b req-de445cdb-69ab-4856-9981-1ac3af305774 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:47 user nova-compute[72441]: WARNING nova.compute.manager [req-b5028c59-75c6-4f22-9e3f-c8084c0b693b req-de445cdb-69ab-4856-9981-1ac3af305774 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_finish.
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609149.4233432, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Resumed (Lifecycle Event)
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:25:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance running successfully.
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Failed to set time: agent not configured {{(pid=72441) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c2d5eb6a-bef4-4243-9dca-2509678cba52 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] finish_migration finished successfully. {{(pid=72441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609149.4244425, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Started (Lifecycle Event)
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:25:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-5d5a8d42-7cf9-45d1-b101-61eca43ab226 req-2b2e26a1-b32e-4bb0-a16e-71afb463e4f8 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5d5a8d42-7cf9-45d1-b101-61eca43ab226 req-2b2e26a1-b32e-4bb0-a16e-71afb463e4f8 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5d5a8d42-7cf9-45d1-b101-61eca43ab226 req-2b2e26a1-b32e-4bb0-a16e-71afb463e4f8 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5d5a8d42-7cf9-45d1-b101-61eca43ab226 req-2b2e26a1-b32e-4bb0-a16e-71afb463e4f8 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-5d5a8d42-7cf9-45d1-b101-61eca43ab226 req-2b2e26a1-b32e-4bb0-a16e-71afb463e4f8 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:25:49 user nova-compute[72441]: WARNING nova.compute.manager [req-5d5a8d42-7cf9-45d1-b101-61eca43ab226 req-2b2e26a1-b32e-4bb0-a16e-71afb463e4f8 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state resize_finish.
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609134.4586644, 6af57e2e-ad59-4567-956f-1547e9b97abb => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:25:49 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] VM Stopped (Lifecycle Event)
Aug 09 19:25:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4debaaa6-7915-4cea-9e28-f129e5994a7b None None] [instance: 6af57e2e-ad59-4567-956f-1547e9b97abb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:25:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:25:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:25:57 user nova-compute[72441]: INFO nova.compute.claims [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Claim successful on node user
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:25:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.policy [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a35ddca8c3c14cd0bde36db805885145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95e03143adf4a188effce696ecaf244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:25:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Creating image(s)
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "/opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "/opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "/opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk 1073741824" returned: 0 in 0.058s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Successfully created port: afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Cannot resize image /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'migration_context' on Instance uuid 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Ensure instance console log exists: /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:58 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:25:58 user nova-compute[72441]: INFO nova.compute.claims [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Claim successful on node user
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:25:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Successfully updated port: afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquired lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-changed-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Refreshing instance network info cache due to event network-changed-afd05d43-10df-4d08-bdd6-e5994b7b8aa0. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] Acquiring lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.policy [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '554ea2267ce94d618fbd7ef211cb7b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d7a9e68495428292b9417ee4b234ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:25:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Creating image(s)
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "/opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updating instance_info_cache with network_info: [{"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Releasing lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Instance network_info: |[{"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] Acquired lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.network.neutron [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Refreshing network info cache for port afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Start _get_guest_xml network_info=[{"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk 1073741824" returned: 0 in 0.065s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:25:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:00 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:00 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1270475299',display_name='tempest-TestStampPattern-server-1270475299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1270475299',id=27,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrZgsijdle9BxvNJuBPf63kpk37GnI0XlUYU0jMHx4vZWwSi+hR41qeqRkciRtRDBfWnZJN+03hS+rGqu74YCdieaN7fN/ECz92zd+TDLdOM4ym5bqAfpDpTlNUP1DeQ==',key_name='tempest-TestStampPattern-2101327217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95e03143adf4a188effce696ecaf244',ramdisk_id='',reservation_id='r-dy7b47c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-907520302',owner_user_name='tempest-TestStampPattern-907520302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:58Z,user_data=None,user_id='a35ddca8c3c14cd0bde36db805885145',uuid=6294a114-45f2-45f4-bfd3-a99fd3c7b61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converting VIF {"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'pci_devices' on Instance uuid 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:26:00 user nova-compute[72441]:   <uuid>6294a114-45f2-45f4-bfd3-a99fd3c7b61d</uuid>
Aug 09 19:26:00 user nova-compute[72441]:   <name>instance-0000001b</name>
Aug 09 19:26:00 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:26:00 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:26:00 user nova-compute[72441]:   <metadata>
Aug 09 19:26:00 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:26:00 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:26:00 user nova-compute[72441]:       <nova:name>tempest-TestStampPattern-server-1270475299</nova:name>
Aug 09 19:26:00 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:26:00</nova:creationTime>
Aug 09 19:26:00 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:26:00 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:26:00 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:26:00 user nova-compute[72441]:       <nova:owner>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:user uuid="a35ddca8c3c14cd0bde36db805885145">tempest-TestStampPattern-907520302-project-member</nova:user>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:project uuid="c95e03143adf4a188effce696ecaf244">tempest-TestStampPattern-907520302</nova:project>
Aug 09 19:26:00 user nova-compute[72441]:       </nova:owner>
Aug 09 19:26:00 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:26:00 user nova-compute[72441]:       <nova:ports>
Aug 09 19:26:00 user nova-compute[72441]:         <nova:port uuid="afd05d43-10df-4d08-bdd6-e5994b7b8aa0">
Aug 09 19:26:00 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:26:00 user nova-compute[72441]:         </nova:port>
Aug 09 19:26:00 user nova-compute[72441]:       </nova:ports>
Aug 09 19:26:00 user nova-compute[72441]:     </nova:instance>
Aug 09 19:26:00 user nova-compute[72441]:   </metadata>
Aug 09 19:26:00 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:26:00 user nova-compute[72441]:     <system>
Aug 09 19:26:00 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:26:00 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:26:00 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:26:00 user nova-compute[72441]:       <entry name="serial">6294a114-45f2-45f4-bfd3-a99fd3c7b61d</entry>
Aug 09 19:26:00 user nova-compute[72441]:       <entry name="uuid">6294a114-45f2-45f4-bfd3-a99fd3c7b61d</entry>
Aug 09 19:26:00 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:26:00 user nova-compute[72441]:     </system>
Aug 09 19:26:00 user nova-compute[72441]:   </sysinfo>
Aug 09 19:26:00 user nova-compute[72441]:   <os>
Aug 09 19:26:00 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:26:00 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:26:00 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:26:00 user nova-compute[72441]:   </os>
Aug 09 19:26:00 user nova-compute[72441]:   <features>
Aug 09 19:26:00 user nova-compute[72441]:     <acpi/>
Aug 09 19:26:00 user nova-compute[72441]:     <apic/>
Aug 09 19:26:00 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:26:00 user nova-compute[72441]:   </features>
Aug 09 19:26:00 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:26:00 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:26:00 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:26:00 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:26:00 user nova-compute[72441]:   </clock>
Aug 09 19:26:00 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:26:00 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:26:00 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:26:00 user nova-compute[72441]:   </cpu>
Aug 09 19:26:00 user nova-compute[72441]:   <devices>
Aug 09 19:26:00 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:26:00 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:26:00 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk"/>
Aug 09 19:26:00 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:26:00 user nova-compute[72441]:     </disk>
Aug 09 19:26:00 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:26:00 user nova-compute[72441]:       <mac address="fa:16:3e:7e:c0:e1"/>
Aug 09 19:26:00 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:26:00 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:26:00 user nova-compute[72441]:       <target dev="tapafd05d43-10"/>
Aug 09 19:26:00 user nova-compute[72441]:     </interface>
Aug 09 19:26:00 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:26:00 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/console.log" append="off"/>
Aug 09 19:26:00 user nova-compute[72441]:     </serial>
Aug 09 19:26:00 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:26:00 user nova-compute[72441]:     <video>
Aug 09 19:26:00 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:26:00 user nova-compute[72441]:     </video>
Aug 09 19:26:00 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:26:00 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:26:00 user nova-compute[72441]:     </rng>
Aug 09 19:26:00 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:26:00 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:26:00 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:26:00 user nova-compute[72441]:     </memballoon>
Aug 09 19:26:00 user nova-compute[72441]:   </devices>
Aug 09 19:26:00 user nova-compute[72441]: </domain>
Aug 09 19:26:00 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1270475299',display_name='tempest-TestStampPattern-server-1270475299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1270475299',id=27,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrZgsijdle9BxvNJuBPf63kpk37GnI0XlUYU0jMHx4vZWwSi+hR41qeqRkciRtRDBfWnZJN+03hS+rGqu74YCdieaN7fN/ECz92zd+TDLdOM4ym5bqAfpDpTlNUP1DeQ==',key_name='tempest-TestStampPattern-2101327217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95e03143adf4a188effce696ecaf244',ramdisk_id='',reservation_id='r-dy7b47c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-907520302',owner_user_name='tempest-TestStampPattern-907520302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:58Z,user_data=None,user_id='a35ddca8c3c14cd0bde36db805885145',uuid=6294a114-45f2-45f4-bfd3-a99fd3c7b61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converting VIF {"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG os_vif [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafd05d43-10, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafd05d43-10, col_values=(('external_ids', {'iface-id': 'afd05d43-10df-4d08-bdd6-e5994b7b8aa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c0:e1', 'vm-uuid': '6294a114-45f2-45f4-bfd3-a99fd3c7b61d'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:26:00 user nova-compute[72441]: INFO os_vif [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10')
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Successfully created port: 714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No VIF found with MAC fa:16:3e:7e:c0:e1, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Cannot resize image /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'migration_context' on Instance uuid 14cc7eae-5cdf-4325-871c-14db3f9507e0 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Ensure instance console log exists: /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updated VIF entry in instance network info cache for port afd05d43-10df-4d08-bdd6-e5994b7b8aa0. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updating instance_info_cache with network_info: [{"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-facb3356-af58-4350-bddb-4cd1b23ab99a req-5b12f2a8-982c-4505-8bb2-98f05e793f37 service nova] Releasing lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Successfully updated port: 714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-14cc7eae-5cdf-4325-871c-14db3f9507e0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-14cc7eae-5cdf-4325-871c-14db3f9507e0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-changed-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Refreshing instance network info cache due to event network-changed-714e194a-bfbd-40b0-bab3-c096d61ed0cb. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] Acquiring lock "refresh_cache-14cc7eae-5cdf-4325-871c-14db3f9507e0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Updating instance_info_cache with network_info: [{"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-14cc7eae-5cdf-4325-871c-14db3f9507e0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Instance network_info: |[{"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] Acquired lock "refresh_cache-14cc7eae-5cdf-4325-871c-14db3f9507e0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Refreshing network info cache for port 714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Start _get_guest_xml network_info=[{"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:26:01 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:01 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1994242009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1994242009',id=28,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-x2j28kbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:59Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=14cc7eae-5cdf-4325-871c-14db3f9507e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'pci_devices' on Instance uuid 14cc7eae-5cdf-4325-871c-14db3f9507e0 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:26:01 user nova-compute[72441]:   <uuid>14cc7eae-5cdf-4325-871c-14db3f9507e0</uuid>
Aug 09 19:26:01 user nova-compute[72441]:   <name>instance-0000001c</name>
Aug 09 19:26:01 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:26:01 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:26:01 user nova-compute[72441]:   <metadata>
Aug 09 19:26:01 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:26:01 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:26:01 user nova-compute[72441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1994242009</nova:name>
Aug 09 19:26:01 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:26:01</nova:creationTime>
Aug 09 19:26:01 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:26:01 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:26:01 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:26:01 user nova-compute[72441]:       <nova:owner>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:user uuid="554ea2267ce94d618fbd7ef211cb7b51">tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member</nova:user>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:project uuid="e0d7a9e68495428292b9417ee4b234ad">tempest-ServerBootFromVolumeStableRescueTest-1993502489</nova:project>
Aug 09 19:26:01 user nova-compute[72441]:       </nova:owner>
Aug 09 19:26:01 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:26:01 user nova-compute[72441]:       <nova:ports>
Aug 09 19:26:01 user nova-compute[72441]:         <nova:port uuid="714e194a-bfbd-40b0-bab3-c096d61ed0cb">
Aug 09 19:26:01 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 19:26:01 user nova-compute[72441]:         </nova:port>
Aug 09 19:26:01 user nova-compute[72441]:       </nova:ports>
Aug 09 19:26:01 user nova-compute[72441]:     </nova:instance>
Aug 09 19:26:01 user nova-compute[72441]:   </metadata>
Aug 09 19:26:01 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:26:01 user nova-compute[72441]:     <system>
Aug 09 19:26:01 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:26:01 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:26:01 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:26:01 user nova-compute[72441]:       <entry name="serial">14cc7eae-5cdf-4325-871c-14db3f9507e0</entry>
Aug 09 19:26:01 user nova-compute[72441]:       <entry name="uuid">14cc7eae-5cdf-4325-871c-14db3f9507e0</entry>
Aug 09 19:26:01 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:26:01 user nova-compute[72441]:     </system>
Aug 09 19:26:01 user nova-compute[72441]:   </sysinfo>
Aug 09 19:26:01 user nova-compute[72441]:   <os>
Aug 09 19:26:01 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:26:01 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:26:01 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:26:01 user nova-compute[72441]:   </os>
Aug 09 19:26:01 user nova-compute[72441]:   <features>
Aug 09 19:26:01 user nova-compute[72441]:     <acpi/>
Aug 09 19:26:01 user nova-compute[72441]:     <apic/>
Aug 09 19:26:01 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:26:01 user nova-compute[72441]:   </features>
Aug 09 19:26:01 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:26:01 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:26:01 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:26:01 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:26:01 user nova-compute[72441]:   </clock>
Aug 09 19:26:01 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:26:01 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:26:01 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:26:01 user nova-compute[72441]:   </cpu>
Aug 09 19:26:01 user nova-compute[72441]:   <devices>
Aug 09 19:26:01 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:26:01 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:26:01 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk"/>
Aug 09 19:26:01 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:26:01 user nova-compute[72441]:     </disk>
Aug 09 19:26:01 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:26:01 user nova-compute[72441]:       <mac address="fa:16:3e:4f:cc:ff"/>
Aug 09 19:26:01 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:26:01 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:26:01 user nova-compute[72441]:       <target dev="tap714e194a-bf"/>
Aug 09 19:26:01 user nova-compute[72441]:     </interface>
Aug 09 19:26:01 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:26:01 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/console.log" append="off"/>
Aug 09 19:26:01 user nova-compute[72441]:     </serial>
Aug 09 19:26:01 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:26:01 user nova-compute[72441]:     <video>
Aug 09 19:26:01 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:26:01 user nova-compute[72441]:     </video>
Aug 09 19:26:01 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:26:01 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:26:01 user nova-compute[72441]:     </rng>
Aug 09 19:26:01 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:26:01 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:26:01 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:26:01 user nova-compute[72441]:     </memballoon>
Aug 09 19:26:01 user nova-compute[72441]:   </devices>
Aug 09 19:26:01 user nova-compute[72441]: </domain>
Aug 09 19:26:01 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1994242009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1994242009',id=28,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-x2j28kbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:25:59Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=14cc7eae-5cdf-4325-871c-14db3f9507e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG os_vif [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap714e194a-bf, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap714e194a-bf, col_values=(('external_ids', {'iface-id': '714e194a-bfbd-40b0-bab3-c096d61ed0cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:cc:ff', 'vm-uuid': '14cc7eae-5cdf-4325-871c-14db3f9507e0'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:01 user nova-compute[72441]: INFO os_vif [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf')
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No VIF found with MAC fa:16:3e:4f:cc:ff, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-8796c39c-0742-423e-81f9-e6842a0fb99c req-5bdb126e-82cd-4412-914c-105af4c4915f service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8796c39c-0742-423e-81f9-e6842a0fb99c req-5bdb126e-82cd-4412-914c-105af4c4915f service nova] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8796c39c-0742-423e-81f9-e6842a0fb99c req-5bdb126e-82cd-4412-914c-105af4c4915f service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8796c39c-0742-423e-81f9-e6842a0fb99c req-5bdb126e-82cd-4412-914c-105af4c4915f service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-8796c39c-0742-423e-81f9-e6842a0fb99c req-5bdb126e-82cd-4412-914c-105af4c4915f service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] No waiting events found dispatching network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:26:01 user nova-compute[72441]: WARNING nova.compute.manager [req-8796c39c-0742-423e-81f9-e6842a0fb99c req-5bdb126e-82cd-4412-914c-105af4c4915f service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received unexpected event network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 for instance with vm_state building and task_state spawning.
Aug 09 19:26:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Updated VIF entry in instance network info cache for port 714e194a-bfbd-40b0-bab3-c096d61ed0cb. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Updating instance_info_cache with network_info: [{"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-92ef69b6-1832-4229-8fde-05719f2b83f8 req-354c6015-e6a7-4173-ab97-b6b44caed9fc service nova] Releasing lock "refresh_cache-14cc7eae-5cdf-4325-871c-14db3f9507e0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] No waiting events found dispatching network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:26:03 user nova-compute[72441]: WARNING nova.compute.manager [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received unexpected event network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 for instance with vm_state building and task_state spawning.
Aug 09 19:26:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-changed-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Refreshing instance network info cache due to event network-changed-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] Acquiring lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] Acquired lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:26:03 user nova-compute[72441]: DEBUG nova.network.neutron [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Refreshing network info cache for port 1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:26:04 user nova-compute[72441]: DEBUG nova.network.neutron [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updated VIF entry in instance network info cache for port 1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:26:04 user nova-compute[72441]: DEBUG nova.network.neutron [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updating instance_info_cache with network_info: [{"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8b3b7a4c-b5b1-4606-a735-34edc60c54c4 req-994e5802-df26-436e-be8f-6cf6712f2180 service nova] Releasing lock "refresh_cache-672e16b3-4cf0-46df-a0b6-d433f613c2f3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609165.129774, 6294a114-45f2-45f4-bfd3-a99fd3c7b61d => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] VM Resumed (Lifecycle Event)
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Instance spawned successfully.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609165.131826, 6294a114-45f2-45f4-bfd3-a99fd3c7b61d => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] VM Started (Lifecycle Event)
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Took 7.44 seconds to spawn the instance on the hypervisor.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Took 8.37 seconds to build instance.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ceda2cfa-8141-489b-ac0f-acb5335181e8 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.478s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609165.6892533, 14cc7eae-5cdf-4325-871c-14db3f9507e0 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] VM Resumed (Lifecycle Event)
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Instance spawned successfully.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609165.6909528, 14cc7eae-5cdf-4325-871c-14db3f9507e0 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] VM Started (Lifecycle Event)
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:26:05 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] No waiting events found dispatching network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:26:05 user nova-compute[72441]: WARNING nova.compute.manager [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received unexpected event network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb for instance with vm_state building and task_state spawning.
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] No waiting events found dispatching network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:26:05 user nova-compute[72441]: WARNING nova.compute.manager [req-4cd72282-e2f8-4ef6-a9c3-2e557b1d6077 req-affe342f-8b15-4d82-9aeb-f413207aae0b service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received unexpected event network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb for instance with vm_state building and task_state spawning.
Aug 09 19:26:06 user nova-compute[72441]: INFO nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Took 6.46 seconds to spawn the instance on the hypervisor.
Aug 09 19:26:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:06 user nova-compute[72441]: INFO nova.compute.manager [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Took 7.38 seconds to build instance.
Aug 09 19:26:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-97e2947f-36fc-436f-8b95-6612082ac07a tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:07 user nova-compute[72441]: INFO nova.compute.manager [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Attaching volume 22d8b293-8677-4629-8679-42baa0864df2 to /dev/vdb
Aug 09 19:26:07 user nova-compute[72441]: DEBUG os_brick.utils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0423fb-df32-49e4-af85-3b81edfa3297]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb70742-1f44-492e-9e44-0670165ebe53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d4c330-3b56-4c3e-b1fb-056531dc5301]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[856fd5a6-6d1a-4fb3-a966-fcc1516baba1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:26:07 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:26:07 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97b8d9d-6391-4bca-b3d2-53f7e1dfa114]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG os_brick.utils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:26:07 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updating existing volume attachment record: 89f4a5c7-f4a9-4866-8be7-23b743e77c51 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:26:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fWhgORku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:26:17 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:26:17 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:26:17 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8850cd-042d-4887-aef3-8f4d3fbd45d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:26:17 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da85160-0468-4eee-a1e1-66913ed9cea5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2] added
Aug 09 19:26:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaf74c6-82b8-4382-a7dc-27682b2b0023]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0341c2-f335-4a63-beeb-9501baa676a4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fWhgORku {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fWhgORku" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d45f1-bd35-4e0f-bbd1-91ed65e124c6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fWhgORku'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc494235-80b2-4ff6-a2bd-9ba0b43acfc5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce7ae5e-2c9c-4690-83e2-dc07657f9f19]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e76820-35db-4749-a897-46a7c1d52b25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260]
Aug 09 19:26:17 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260] successful.
Aug 09 19:26:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a9555a-fb16-4e6d-9435-6bd4f8e404b7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc19320-3ad4-4de2-84a5-cea848ad8867]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 (non-flash)
Aug 09 19:26:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f164b0-120c-4406-a334-5545eb5e55d5]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:26:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fWhgORku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:26:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:26:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23836353037653933', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:26:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836353037653933', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:26:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:26:18 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:26:18 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:26:18 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:26:18 user nova-compute[72441]:   <serial>22d8b293-8677-4629-8679-42baa0864df2</serial>
Aug 09 19:26:18 user nova-compute[72441]: </disk>
Aug 09 19:26:18 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:26:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:26:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:26:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:62:39:ec, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:26:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-70166053-8053-4edb-b57d-f0ea044d277f tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.052s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:20 user nova-compute[72441]: INFO nova.compute.manager [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Detaching volume 22d8b293-8677-4629-8679-42baa0864df2
Aug 09 19:26:20 user nova-compute[72441]: INFO nova.virt.block_device [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Attempting to driver detach volume 22d8b293-8677-4629-8679-42baa0864df2 from mountpoint /dev/vdb
Aug 09 19:26:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Attempting to detach device vdb from instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:26:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:26:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:26:20 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:26:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:26:20 user nova-compute[72441]:   <serial>22d8b293-8677-4629-8679-42baa0864df2</serial>
Aug 09 19:26:20 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:26:20 user nova-compute[72441]: </disk>
Aug 09 19:26:20 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:26:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully detached device vdb from instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 from the persistent domain config.
Aug 09 19:26:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:26:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:26:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:26:20 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:26:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:26:20 user nova-compute[72441]:   <serial>22d8b293-8677-4629-8679-42baa0864df2</serial>
Aug 09 19:26:20 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:26:20 user nova-compute[72441]: </disk>
Aug 09 19:26:20 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609181.47174, 672e16b3-4cf0-46df-a0b6-d433f613c2f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:26:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully detached device vdb from instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 from the live domain config.
Aug 09 19:26:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fWhgORku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:26:21 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e29c4-81d8-489d-92e7-535efe884eb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[660c4d5e-ab25-4630-8736-6e5d37683345]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 (non-flash)
Aug 09 19:26:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984fc9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[196aab26-409c-4ef9-a024-6bd36eea60d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed88b83-f1ff-441b-865f-e1c87f246593]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87fc6cf-06a4-42ea-9015-e0e81d8c4a0a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bf974b-44dd-4872-bb6a-e3cf734a285d]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[566dcb8a-d1e4-4381-9f32-5306ea665c69]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[305233ad-308a-4439-a1e1-808a6be07853]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260]
Aug 09 19:26:21 user nova-compute[72441]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2, portal: 172.16.0.220,3260] successful.
Aug 09 19:26:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8b293-8677-4629-8679-42baa0864df2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[234862b8-ba7a-45af-b20f-2e64dfca0cd8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== disconnect_volume: return (344ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:26:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:26:22 user nova-compute[72441]: DEBUG nova.objects.instance [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-951af741-1734-4196-abf6-3b8e9371be9e tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:24 user nova-compute[72441]: INFO nova.compute.manager [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Detaching volume 2f97fa00-be47-4cc2-8a0d-7276726b4001
Aug 09 19:26:24 user nova-compute[72441]: INFO nova.virt.block_device [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Attempting to driver detach volume 2f97fa00-be47-4cc2-8a0d-7276726b4001 from mountpoint /dev/vdc
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Attempting to detach device vdc from instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:26:24 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:26:24 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:26:24 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:26:24 user nova-compute[72441]:   <serial>2f97fa00-be47-4cc2-8a0d-7276726b4001</serial>
Aug 09 19:26:24 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:26:24 user nova-compute[72441]: </disk>
Aug 09 19:26:24 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:26:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully detached device vdc from instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 from the persistent domain config.
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:26:24 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:26:24 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:26:24 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:26:24 user nova-compute[72441]:   <serial>2f97fa00-be47-4cc2-8a0d-7276726b4001</serial>
Aug 09 19:26:24 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:26:24 user nova-compute[72441]: </disk>
Aug 09 19:26:24 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609184.7686844, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:26:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully detached device vdc from instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 from the live domain config.
Aug 09 19:26:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ospZHUBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:26:24 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4892d3-5e8c-42f4-934a-3d48a717b734]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2897857-1235-4b4d-a7e2-ca0fd30396dc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:24 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:24 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:24 user nova-compute[72441]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 (non-flash)
Aug 09 19:26:24 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984ff760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4d2933-dce0-4456-b68a-fd08035cf078]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef79fb5-0900-425e-91fc-5cdb57a97383]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e989c-a914-420e-bd82-4d06dc991096]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4d8753-4b9d-469e-8140-e0e7a21f093d]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd9d03a-71af-4e2e-9bfc-f21fb7912080]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d755064-2d21-4ba0-af99-282e0355cf9e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260]
Aug 09 19:26:25 user nova-compute[72441]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001, portal: 172.16.0.220,3260] successful.
Aug 09 19:26:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f97fa00-be47-4cc2-8a0d-7276726b4001 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf707a12-864a-4f7f-9325-437f30c3fa9a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] <== disconnect_volume: return (278ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'flavor' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ee6fd2c-628d-40bf-bc27-dbdb9f0afb1a tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:26:28 user nova-compute[72441]: INFO nova.compute.claims [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Claim successful on node user
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:26:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:26:29 user nova-compute[72441]: INFO nova.virt.block_device [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Booting with volume c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 at /dev/vda
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.policy [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6d604b2b0d64d9285df9088ee2e8c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4775870464a74454992c156806470beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb561a-5bba-47e4-a8b9-70d11b4d0080]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c366ce-9f7c-497b-8d14-6c1b0159e45c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc37d2-2f1a-4e04-b551-7a5ed54ae239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cd4ea0-4133-47e3-9477-5f6039ab5c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:26:29 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12240dd-84cd-4cf7-b5ee-939409de6ce7]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating existing volume attachment record: dae1d9bf-80bb-49ea-a5a5-73314f68a53f {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Successfully created port: 90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Successfully updated port: 90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-changed-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Refreshing instance network info cache due to event network-changed-90f08f9d-d5d3-474a-a749-1333262e0c9c. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] Acquiring lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] Acquired lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Refreshing network info cache for port 90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:26:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6551MB free_disk=25.12329864501953GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Applying migration context for instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c as it has an incoming, in-progress migration 74640d4e-4dcf-4aec-912f-32627fc4d57f. Migration status is finished {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 19:26:32 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating resource usage from migration 74640d4e-4dcf-4aec-912f-32627fc4d57f
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 9993e22d-c00a-497a-bb28-500abdc8a2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance f0c45570-1b41-4666-9fe0-ed489926132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Migration 74640d4e-4dcf-4aec-912f-32627fc4d57f is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3c324d8a-df2d-4fda-bcb4-8fb7d2afa11d req-e2a8e924-7370-4423-8efa-d4623caa2ed2 service nova] Releasing lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquired lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:26:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Releasing lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance network_info: |[{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:26:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:26:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:26:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Creating image(s)
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Ensure instance console log exists: /opt/stack/data/nova/instances/bb15c890-ce98-4e03-811f-8459d12120f8/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Start _get_guest_xml network_info=[{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb15c890-ce98-4e03-811f-8459d12120f8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9659761-2eaf-4e18-b58d-d8cea9cc6dd3', 'serial': 'c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'}, 'attachment_id': 'dae1d9bf-80bb-49ea-a5a5-73314f68a53f', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:26:41 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:41 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:26:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:26:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:26:41 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d0803-6a0d-4914-9f64-60afb81c428f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:26:41 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e58c98-c4ed-4109-8360-d5ad3bc4410f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3] added
Aug 09 19:26:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a364b62a-d1b5-439d-a4e7-d7ddc4b24024]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2cd9dd-26ed-45dc-a032-8975367b2392]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWKnCSgY {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWKnCSgY" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f13bb9-2a2f-4e58-9edc-f7624ff8db16]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kWKnCSgY'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7350f83-5a25-41bc-aa4c-8d57c1382552]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd5772-eccd-4bcd-813a-b9f1e7df1280]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4295604e-74c7-4fd0-be51-c3e7a08fb850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]
Aug 09 19:26:41 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.
Aug 09 19:26:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[30739d7b-b11e-4433-b898-4efeb61d04eb]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78404db5-9e33-41b4-8971-ba6a0d15ac01]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:26:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd48ad3-7374-456d-90c5-d90b65a8c901]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:26:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23561656463356530', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561656463356530', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1170996063',display_name='tempest-ServerActionsTestOtherA-server-1170996063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1170996063',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1pusvuyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=bb15c890-ce98-4e03-811f-8459d12120f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'pci_devices' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:26:42 user nova-compute[72441]:   <uuid>bb15c890-ce98-4e03-811f-8459d12120f8</uuid>
Aug 09 19:26:42 user nova-compute[72441]:   <name>instance-0000001d</name>
Aug 09 19:26:42 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:26:42 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:26:42 user nova-compute[72441]:   <metadata>
Aug 09 19:26:42 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:26:42 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:26:42 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherA-server-1170996063</nova:name>
Aug 09 19:26:42 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:26:41</nova:creationTime>
Aug 09 19:26:42 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:26:42 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:26:42 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:26:42 user nova-compute[72441]:       <nova:owner>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:user uuid="b6d604b2b0d64d9285df9088ee2e8c80">tempest-ServerActionsTestOtherA-683008927-project-member</nova:user>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:project uuid="4775870464a74454992c156806470beb">tempest-ServerActionsTestOtherA-683008927</nova:project>
Aug 09 19:26:42 user nova-compute[72441]:       </nova:owner>
Aug 09 19:26:42 user nova-compute[72441]:       <nova:ports>
Aug 09 19:26:42 user nova-compute[72441]:         <nova:port uuid="90f08f9d-d5d3-474a-a749-1333262e0c9c">
Aug 09 19:26:42 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:26:42 user nova-compute[72441]:         </nova:port>
Aug 09 19:26:42 user nova-compute[72441]:       </nova:ports>
Aug 09 19:26:42 user nova-compute[72441]:     </nova:instance>
Aug 09 19:26:42 user nova-compute[72441]:   </metadata>
Aug 09 19:26:42 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:26:42 user nova-compute[72441]:     <system>
Aug 09 19:26:42 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:26:42 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:26:42 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:26:42 user nova-compute[72441]:       <entry name="serial">bb15c890-ce98-4e03-811f-8459d12120f8</entry>
Aug 09 19:26:42 user nova-compute[72441]:       <entry name="uuid">bb15c890-ce98-4e03-811f-8459d12120f8</entry>
Aug 09 19:26:42 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:26:42 user nova-compute[72441]:     </system>
Aug 09 19:26:42 user nova-compute[72441]:   </sysinfo>
Aug 09 19:26:42 user nova-compute[72441]:   <os>
Aug 09 19:26:42 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:26:42 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:26:42 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:26:42 user nova-compute[72441]:   </os>
Aug 09 19:26:42 user nova-compute[72441]:   <features>
Aug 09 19:26:42 user nova-compute[72441]:     <acpi/>
Aug 09 19:26:42 user nova-compute[72441]:     <apic/>
Aug 09 19:26:42 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:26:42 user nova-compute[72441]:   </features>
Aug 09 19:26:42 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:26:42 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:26:42 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:26:42 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:26:42 user nova-compute[72441]:   </clock>
Aug 09 19:26:42 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:26:42 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:26:42 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:26:42 user nova-compute[72441]:   </cpu>
Aug 09 19:26:42 user nova-compute[72441]:   <devices>
Aug 09 19:26:42 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:26:42 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:26:42 user nova-compute[72441]:       <source dev="/dev/sdc"/>
Aug 09 19:26:42 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:26:42 user nova-compute[72441]:       <serial>c9659761-2eaf-4e18-b58d-d8cea9cc6dd3</serial>
Aug 09 19:26:42 user nova-compute[72441]:     </disk>
Aug 09 19:26:42 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:26:42 user nova-compute[72441]:       <mac address="fa:16:3e:97:5e:be"/>
Aug 09 19:26:42 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:26:42 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:26:42 user nova-compute[72441]:       <target dev="tap90f08f9d-d5"/>
Aug 09 19:26:42 user nova-compute[72441]:     </interface>
Aug 09 19:26:42 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:26:42 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/bb15c890-ce98-4e03-811f-8459d12120f8/console.log" append="off"/>
Aug 09 19:26:42 user nova-compute[72441]:     </serial>
Aug 09 19:26:42 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:26:42 user nova-compute[72441]:     <video>
Aug 09 19:26:42 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:26:42 user nova-compute[72441]:     </video>
Aug 09 19:26:42 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:26:42 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:26:42 user nova-compute[72441]:     </rng>
Aug 09 19:26:42 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:26:42 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:26:42 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:26:42 user nova-compute[72441]:     </memballoon>
Aug 09 19:26:42 user nova-compute[72441]:   </devices>
Aug 09 19:26:42 user nova-compute[72441]: </domain>
Aug 09 19:26:42 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1170996063',display_name='tempest-ServerActionsTestOtherA-server-1170996063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1170996063',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1pusvuyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=bb15c890-ce98-4e03-811f-8459d12120f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG os_vif [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90f08f9d-d5, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90f08f9d-d5, col_values=(('external_ids', {'iface-id': '90f08f9d-d5d3-474a-a749-1333262e0c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:5e:be', 'vm-uuid': 'bb15c890-ce98-4e03-811f-8459d12120f8'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:42 user nova-compute[72441]: INFO os_vif [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5')
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:26:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No VIF found with MAC fa:16:3e:97:5e:be, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-444a9d9b-f8ad-4d28-8685-c52ea25097cf req-30bff414-c94a-43a8-9e2b-95c826b75020 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-444a9d9b-f8ad-4d28-8685-c52ea25097cf req-30bff414-c94a-43a8-9e2b-95c826b75020 service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-444a9d9b-f8ad-4d28-8685-c52ea25097cf req-30bff414-c94a-43a8-9e2b-95c826b75020 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-444a9d9b-f8ad-4d28-8685-c52ea25097cf req-30bff414-c94a-43a8-9e2b-95c826b75020 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-444a9d9b-f8ad-4d28-8685-c52ea25097cf req-30bff414-c94a-43a8-9e2b-95c826b75020 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:26:44 user nova-compute[72441]: WARNING nova.compute.manager [req-444a9d9b-f8ad-4d28-8685-c52ea25097cf req-30bff414-c94a-43a8-9e2b-95c826b75020 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state building and task_state spawning.
Aug 09 19:26:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609206.3517907, bb15c890-ce98-4e03-811f-8459d12120f8 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] VM Resumed (Lifecycle Event)
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance spawned successfully.
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609206.356477, bb15c890-ce98-4e03-811f-8459d12120f8 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] VM Started (Lifecycle Event)
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-4a80b73b-c921-4ff2-9eb4-7f400dbad776 req-b688c2a2-e419-4bd2-aed6-96ecb48873c2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a80b73b-c921-4ff2-9eb4-7f400dbad776 req-b688c2a2-e419-4bd2-aed6-96ecb48873c2 service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a80b73b-c921-4ff2-9eb4-7f400dbad776 req-b688c2a2-e419-4bd2-aed6-96ecb48873c2 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a80b73b-c921-4ff2-9eb4-7f400dbad776 req-b688c2a2-e419-4bd2-aed6-96ecb48873c2 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-4a80b73b-c921-4ff2-9eb4-7f400dbad776 req-b688c2a2-e419-4bd2-aed6-96ecb48873c2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:26:46 user nova-compute[72441]: WARNING nova.compute.manager [req-4a80b73b-c921-4ff2-9eb4-7f400dbad776 req-b688c2a2-e419-4bd2-aed6-96ecb48873c2 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state building and task_state spawning.
Aug 09 19:26:46 user nova-compute[72441]: INFO nova.compute.manager [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Took 18.10 seconds to build instance.
Aug 09 19:26:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd989127-d3e0-476f-9284-7a1d44825ced tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.213s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:26:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:26:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:26:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:26:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:26:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:26:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'flavor' on Instance uuid 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:09 user nova-compute[72441]: INFO nova.compute.manager [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Attaching volume 2a46028f-a19c-43de-9d7c-ee01eb55df17 to /dev/vdb
Aug 09 19:27:09 user nova-compute[72441]: DEBUG os_brick.utils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16db091-d84f-4594-8aed-861c63e6cc0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b9236-c8e9-457d-92ad-8222b0ab3782]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558cc8a-919e-4497-a0de-196018bb954e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1062e9c1-ac91-4de0-9c4f-24575b4de008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:09 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:27:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[07954f5a-c207-4c66-aa24-d0cd4901aa46]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG os_brick.utils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:09 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating existing volume attachment record: fbfbf91e-e908-4ea7-9574-19763ea0197f {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:27:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:11 user nova-compute[72441]: INFO nova.compute.manager [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Terminating instance
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-efc381e2-ef85-465f-a53f-275f6e1df88c req-1affffb9-2a92-405c-b8e2-be8f52aa4cf9 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-vif-unplugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-efc381e2-ef85-465f-a53f-275f6e1df88c req-1affffb9-2a92-405c-b8e2-be8f52aa4cf9 service nova] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-efc381e2-ef85-465f-a53f-275f6e1df88c req-1affffb9-2a92-405c-b8e2-be8f52aa4cf9 service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-efc381e2-ef85-465f-a53f-275f6e1df88c req-1affffb9-2a92-405c-b8e2-be8f52aa4cf9 service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-efc381e2-ef85-465f-a53f-275f6e1df88c req-1affffb9-2a92-405c-b8e2-be8f52aa4cf9 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] No waiting events found dispatching network-vif-unplugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-efc381e2-ef85-465f-a53f-275f6e1df88c req-1affffb9-2a92-405c-b8e2-be8f52aa4cf9 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-vif-unplugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-changed-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Refreshing instance network info cache due to event network-changed-f88a4415-bd67-4929-be84-66c1fdee068e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] Acquiring lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] Acquired lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Refreshing network info cache for port f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Instance destroyed successfully.
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'resources' on Instance uuid 672e16b3-4cf0-46df-a0b6-d433f613c2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-589522278',display_name='tempest-AttachVolumeNegativeTest-server-589522278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-589522278',id=23,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNriLsb0Qqgw2lDOeL57HrM3diHnaJvw/o5g9XZjFLhrFSCgxqfD3tfG+5UtOpwPPldU8tHwoABlf2+98Erf2q1Swq76fGlZC+NhmQRqZi3/F4krLvq2eYN9kqTobH1yw==',key_name='tempest-keypair-1137834800',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-tf9kgqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=672e16b3-4cf0-46df-a0b6-d433f613c2f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "address": "fa:16:3e:62:39:ec", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f53a8dc-b0", "ovs_interfaceid": "1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG os_vif [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f53a8dc-b0, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:27:11 user nova-compute[72441]: INFO os_vif [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:39:ec,bridge_name='br-int',has_traffic_filtering=True,id=1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f53a8dc-b0')
Aug 09 19:27:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Deleting instance files /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3_del
Aug 09 19:27:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Deletion of /opt/stack/data/nova/instances/672e16b3-4cf0-46df-a0b6-d433f613c2f3_del complete
Aug 09 19:27:12 user nova-compute[72441]: INFO nova.compute.manager [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:12 user nova-compute[72441]: INFO nova.compute.manager [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Terminating instance
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "interface-f0c45570-1b41-4666-9fe0-ed489926132b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "interface-f0c45570-1b41-4666-9fe0-ed489926132b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'flavor' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updated VIF entry in instance network info cache for port f88a4415-bd67-4929-be84-66c1fdee068e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fe693d8-9b31-4326-a154-037b204868d6 req-275ec6a1-5a21-40ce-8fea-457d4218759e service nova] Releasing lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'pci_requests' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.policy [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f208845e39d41c5b4a2b76748c8e658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57335007b06a45ad9f91aa03555d5428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:27:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Instance destroyed successfully.
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lazy-loading 'resources' on Instance uuid 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1562489233',display_name='tempest-VolumesActionsTest-instance-1562489233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1562489233',id=26,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd1c396deeca4c219140761e4bd8141d',ramdisk_id='',reservation_id='r-fyxm6k1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-57443595',owner_user_name='tempest-VolumesActionsTest-57443595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:30Z,user_data=None,user_id='e95cede1cc2549dfb6c82d2baeaaf39a',uuid=35cf4c2d-73eb-4973-8fe7-49de92ff46c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converting VIF {"id": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "address": "fa:16:3e:29:35:16", "network": {"id": "4607d5f7-94b5-4dc2-a267-0b0f1021ff20", "bridge": "br-int", "label": "tempest-VolumesActionsTest-421497429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1c396deeca4c219140761e4bd8141d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f27d0f-fe", "ovs_interfaceid": "89f27d0f-fe9c-4ec2-9361-25acbd89c290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG os_vif [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89f27d0f-fe, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:12 user nova-compute[72441]: INFO os_vif [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:35:16,bridge_name='br-int',has_traffic_filtering=True,id=89f27d0f-fe9c-4ec2-9361-25acbd89c290,network=Network(4607d5f7-94b5-4dc2-a267-0b0f1021ff20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f27d0f-fe')
Aug 09 19:27:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Deleting instance files /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4_del
Aug 09 19:27:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Deletion of /opt/stack/data/nova/instances/35cf4c2d-73eb-4973-8fe7-49de92ff46c4_del complete
Aug 09 19:27:12 user nova-compute[72441]: INFO nova.compute.manager [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 09 19:27:12 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:27:12 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Successfully created port: df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:13 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Took 1.40 seconds to deallocate network for instance.
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-3cf1cbdf-88d3-4eee-8bec-2301385a4c2e req-b60bbcec-e5e6-4bd7-9579-d55f377f2a80 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3cf1cbdf-88d3-4eee-8bec-2301385a4c2e req-b60bbcec-e5e6-4bd7-9579-d55f377f2a80 service nova] Acquiring lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3cf1cbdf-88d3-4eee-8bec-2301385a4c2e req-b60bbcec-e5e6-4bd7-9579-d55f377f2a80 service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3cf1cbdf-88d3-4eee-8bec-2301385a4c2e req-b60bbcec-e5e6-4bd7-9579-d55f377f2a80 service nova] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-3cf1cbdf-88d3-4eee-8bec-2301385a4c2e req-b60bbcec-e5e6-4bd7-9579-d55f377f2a80 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] No waiting events found dispatching network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:13 user nova-compute[72441]: WARNING nova.compute.manager [req-3cf1cbdf-88d3-4eee-8bec-2301385a4c2e req-b60bbcec-e5e6-4bd7-9579-d55f377f2a80 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received unexpected event network-vif-plugged-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a for instance with vm_state active and task_state deleting.
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:13 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Took 0.76 seconds to deallocate network for instance.
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received event network-vif-unplugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] No waiting events found dispatching network-vif-unplugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:13 user nova-compute[72441]: WARNING nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received unexpected event network-vif-unplugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 for instance with vm_state deleted and task_state None.
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received event network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] Acquiring lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] No waiting events found dispatching network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:13 user nova-compute[72441]: WARNING nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received unexpected event network-vif-plugged-89f27d0f-fe9c-4ec2-9361-25acbd89c290 for instance with vm_state deleted and task_state None.
Aug 09 19:27:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9fb5455-ebea-464f-906d-d8aa7c8542ec req-4dbe2053-c4a9-4f01-a157-08d40ad20d35 service nova] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Received event network-vif-deleted-1f53a8dc-b0d3-4fa9-b588-f6186fa9cf7a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.351s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:14 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Deleted allocations for instance 672e16b3-4cf0-46df-a0b6-d433f613c2f3
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Successfully updated port: df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquired lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-changed-df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Refreshing instance network info cache due to event network-changed-df8ca981-7c71-4d6d-b478-55bc0b60b5dd. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] Acquiring lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dd030a6a-3f49-4b99-b144-f261c2cf8abe tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "672e16b3-4cf0-46df-a0b6-d433f613c2f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.101s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:14 user nova-compute[72441]: INFO nova.compute.manager [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Terminating instance
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:14 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Deleted allocations for instance 35cf4c2d-73eb-4973-8fe7-49de92ff46c4
Aug 09 19:27:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8cc97dfa-9aee-4dfc-8fdf-6a4fcae416b1 tempest-VolumesActionsTest-57443595 tempest-VolumesActionsTest-57443595-project-member] Lock "35cf4c2d-73eb-4973-8fe7-49de92ff46c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Releasing lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] Acquired lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Refreshing network info cache for port df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG os_vif [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf8ca981-7c, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf8ca981-7c, col_values=(('external_ids', {'iface-id': 'df8ca981-7c71-4d6d-b478-55bc0b60b5dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:71:63', 'vm-uuid': 'f0c45570-1b41-4666-9fe0-ed489926132b'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:27:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Instance destroyed successfully.
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'resources' on Instance uuid 9993e22d-c00a-497a-bb28-500abdc8a2f3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1532187531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1532187531',id=15,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyxkh/V7vIgiMnU5QRCpAzARoVccI/y1XmvHfLb2SGY89lpnKEea3r9+ah0UaGRCubwtIL5m+b9uqo633s5bE0ycaZIo0ehTjBYDEAzcUysqkf66kOCodYMVbH11gJuVg==',key_name='tempest-keypair-399743535',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-yp85lf82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=9993e22d-c00a-497a-bb28-500abdc8a2f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "address": "fa:16:3e:b9:ae:39", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4549fab1-2c", "ovs_interfaceid": "4549fab1-2c9e-42d0-8941-d981d3dee0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG os_vif [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: INFO os_vif [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c')
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4549fab1-2c, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] attach device xml: <interface type="ethernet">
Aug 09 19:27:15 user nova-compute[72441]:   <mac address="fa:16:3e:cd:71:63"/>
Aug 09 19:27:15 user nova-compute[72441]:   <model type="virtio"/>
Aug 09 19:27:15 user nova-compute[72441]:   <mtu size="1442"/>
Aug 09 19:27:15 user nova-compute[72441]:   <target dev="tapdf8ca981-7c"/>
Aug 09 19:27:15 user nova-compute[72441]: </interface>
Aug 09 19:27:15 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: INFO os_vif [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ae:39,bridge_name='br-int',has_traffic_filtering=True,id=4549fab1-2c9e-42d0-8941-d981d3dee0b7,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4549fab1-2c')
Aug 09 19:27:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Deleting instance files /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3_del
Aug 09 19:27:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Deletion of /opt/stack/data/nova/instances/9993e22d-c00a-497a-bb28-500abdc8a2f3_del complete
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Received event network-vif-deleted-89f27d0f-fe9c-4ec2-9361-25acbd89c290 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-unplugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-unplugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-unplugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] Acquiring lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] No waiting events found dispatching network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:15 user nova-compute[72441]: WARNING nova.compute.manager [req-44ce663b-80d6-4670-9f24-a8072150433d req-ee69b46c-029e-487e-a0dc-c54a3b928b39 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received unexpected event network-vif-plugged-4549fab1-2c9e-42d0-8941-d981d3dee0b7 for instance with vm_state active and task_state deleting.
Aug 09 19:27:15 user nova-compute[72441]: INFO nova.compute.manager [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updated VIF entry in instance network info cache for port df8ca981-7c71-4d6d-b478-55bc0b60b5dd. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-83c0c6a6-dfc6-4ab7-a3b1-26d791377918 req-429f5230-f958-4a4b-b603-08dfbb79173d service nova] Releasing lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No BDM found with device name hda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No VIF found with MAC fa:16:3e:d4:a5:a9, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-a2857fba-2b39-4425-b35f-0d4458574276 req-9dbd2925-a2ad-4900-afe4-feb2bc3dc30d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2857fba-2b39-4425-b35f-0d4458574276 req-9dbd2925-a2ad-4900-afe4-feb2bc3dc30d service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2857fba-2b39-4425-b35f-0d4458574276 req-9dbd2925-a2ad-4900-afe4-feb2bc3dc30d service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a2857fba-2b39-4425-b35f-0d4458574276 req-9dbd2925-a2ad-4900-afe4-feb2bc3dc30d service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-a2857fba-2b39-4425-b35f-0d4458574276 req-9dbd2925-a2ad-4900-afe4-feb2bc3dc30d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:15 user nova-compute[72441]: WARNING nova.compute.manager [req-a2857fba-2b39-4425-b35f-0d4458574276 req-9dbd2925-a2ad-4900-afe4-feb2bc3dc30d service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-df8ca981-7c71-4d6d-b478-55bc0b60b5dd for instance with vm_state active and task_state None.
Aug 09 19:27:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:15 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:15 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:15 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:15</nova:creationTime>
Aug 09 19:27:15 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:15 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:15 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:15 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:15 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:15 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:15 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:15 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:15 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:15 user nova-compute[72441]:     <nova:port uuid="df8ca981-7c71-4d6d-b478-55bc0b60b5dd">
Aug 09 19:27:15 user nova-compute[72441]:       <nova:ip type="fixed" address="10.10.10.206" ipVersion="4"/>
Aug 09 19:27:15 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:15 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:15 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:15 user nova-compute[72441]:  {{(pid=72441) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-774fc209-6b51-49b1-92d4-187fb91c1b9e tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "interface-f0c45570-1b41-4666-9fe0-ed489926132b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.716s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'flavor' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:16 user nova-compute[72441]: INFO nova.compute.manager [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Attaching volume 5c3783b5-e14e-43fb-8502-c3cfb863b153 to /dev/vdb
Aug 09 19:27:16 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:16 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Took 1.21 seconds to deallocate network for instance.
Aug 09 19:27:16 user nova-compute[72441]: DEBUG os_brick.utils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc1d42d-2522-42e2-97a0-ee43bd4c2a48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[120dd991-2758-4a1d-930b-02d06f173b7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa0769b-b4e3-4c7a-9528-d6d6a860aa0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6695ba4c-4ad2-467e-88b2-4e15df148693]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:27:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Port 2cacd5ec-a169-42d7-b356-5878fa2373ed binding to destination host user is already ACTIVE {{(pid=72441) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:17 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc4f14b-21b6-4970-8912-6c30948f3b76]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG os_brick.utils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating existing volume attachment record: eef5bcc0-1673-47d1-ad5b-3f9f3159deb7 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:17 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Deleted allocations for instance 9993e22d-c00a-497a-bb28-500abdc8a2f3
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5dcbc50d-df0e-46f9-91c6-f14d515df9c3 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "9993e22d-c00a-497a-bb28-500abdc8a2f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.912s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Creating tmpfile /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/tmpwqihri0y to verify with other compute node that the instance is on the same shared storage. {{(pid=72441) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-b456b021-230b-4009-8fc5-4594c0fdf3b9 req-2dd16232-f4ea-46e9-959e-87dbdce14987 service nova] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Received event network-vif-deleted-4549fab1-2c9e-42d0-8941-d981d3dee0b7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:18 user nova-compute[72441]: WARNING nova.compute.manager [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-df8ca981-7c71-4d6d-b478-55bc0b60b5dd for instance with vm_state active and task_state None.
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:18 user nova-compute[72441]: WARNING nova.compute.manager [req-773c9f37-02a2-4247-8baa-20e3ba910ef3 req-f2615427-598a-4360-b40d-29c392547fa1 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state resized and task_state resize_reverting.
Aug 09 19:27:18 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance destroyed successfully.
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'resources' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cacd5ec-a1, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:27:18 user nova-compute[72441]: INFO os_vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1')
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:18 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e3037-3f5d-414d-9031-960d82b6213b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a4050d-e65e-40d2-8f7d-8997301b2701]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)
Aug 09 19:27:18 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9835e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a0aae4-cf3e-489a-a6e1-edcb0ae1d5d7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[871f25af-81d3-4d92-95aa-27806b13d29f]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa53889-1399-4801-b3fa-913aa988e020]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dbfdc6-7429-49e2-88a3-34b689c3c15b]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e914a05c-2ae8-4970-bfeb-e8758603d877]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d2e46-15b9-4730-8e1e-8ff16b31401a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]
Aug 09 19:27:18 user nova-compute[72441]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.
Aug 09 19:27:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a02890-7a65-4d90-b1ed-7d500137ab32]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== disconnect_volume: return (375ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:27:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:19 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'migration_context' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-f7241cc4-5c8b-4e31-a035-7e06d3e9327c req-c57c0b41-ac99-40bb-a4e5-cc829adcf64d service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f7241cc4-5c8b-4e31-a035-7e06d3e9327c req-c57c0b41-ac99-40bb-a4e5-cc829adcf64d service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f7241cc4-5c8b-4e31-a035-7e06d3e9327c req-c57c0b41-ac99-40bb-a4e5-cc829adcf64d service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f7241cc4-5c8b-4e31-a035-7e06d3e9327c req-c57c0b41-ac99-40bb-a4e5-cc829adcf64d service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-f7241cc4-5c8b-4e31-a035-7e06d3e9327c req-c57c0b41-ac99-40bb-a4e5-cc829adcf64d service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:20 user nova-compute[72441]: WARNING nova.compute.manager [req-f7241cc4-5c8b-4e31-a035-7e06d3e9327c req-c57c0b41-ac99-40bb-a4e5-cc829adcf64d service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state resized and task_state resize_reverting.
Aug 09 19:27:20 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.580s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:20 user nova-compute[72441]: INFO nova.compute.manager [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Swapping old allocation on dict_keys(['e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5']) held by migration 74640d4e-4dcf-4aec-912f-32627fc4d57f for instance
Aug 09 19:27:20 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Overwriting current allocation {'allocations': {'e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 34}}, 'project_id': '4468899cba1a4bfe8a68af07b58b0a04', 'user_id': 'de57b5e4f9f54fffa53d91f9a6afd092', 'consumer_generation': 1} on consumer 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquired lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:20 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLDkQRWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:21 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:21 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:21 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ce6d6d-65d7-4d69-8fb8-8f74f8ff2665]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:27:21 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[386cfd38-3cf9-4d95-8113-5a93f03e64bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17] added
Aug 09 19:27:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e30206-6ef3-4927-a03e-6baf82a18435]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d0e76-5754-49da-81fc-7f1811c9493b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLDkQRWN {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLDkQRWN" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bbbc96-e658-4d72-a40d-d442fed04af3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zLDkQRWN'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8648f1-33ef-4734-93f0-30fff513b5d6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ddc866-ebe3-40f9-b7aa-f6f2f1917c13]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3078699-829f-49c5-a4bd-70f22e7f083e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260]
Aug 09 19:27:21 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260] successful.
Aug 09 19:27:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[75543dd8-31ee-4bff-a2da-02b1cbed6a9b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ec422-5b18-4add-a640-afd27ea2992a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14db38-3b90-4565-a783-a013935ffb4e (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef0a07-d668-4054-b5de-0d6a2b47b2b7]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLDkQRWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Releasing lock "refresh_cache-33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd358f8-7741-404b-818c-e5f3efece466]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6db0228-0d31-46cf-bef2-e3736e92d259]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b241919-409c-4d93-babe-d0c7c52f8a75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[464cf19c-1bfa-4bd9-8e60-bd3f0b5ea65f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:21 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:27:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591f823-8fdc-462e-9a5c-63b173a4049d]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:27:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23630623730633837', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630623730633837', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:27:22 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'flavor' on Instance uuid 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:27:22 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:27:22 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:27:22 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:27:22 user nova-compute[72441]:   <serial>2a46028f-a19c-43de-9d7c-ee01eb55df17</serial>
Aug 09 19:27:22 user nova-compute[72441]: </disk>
Aug 09 19:27:22 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:27:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] No VIF found with MAC fa:16:3e:41:64:4a, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:27:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3c230b59-bbd2-40bb-9f85-ae301ed79f19 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.603s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:25 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:27:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing instance network info cache due to event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:26 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609231.926365, 672e16b3-4cf0-46df-a0b6-d433f613c2f3 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:26 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] VM Stopped (Lifecycle Event)
Aug 09 19:27:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0d56c774-55a8-4a7c-8847-315dda96c225 None None] [instance: 672e16b3-4cf0-46df-a0b6-d433f613c2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updated VIF entry in instance network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-80cf0d16-3b20-4f32-8bef-d6a478676fd0 req-3f47a4fe-86b9-4a90-9126-3251fe95c73f service nova] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMNZdzcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:27 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c9c26-2fd3-4f4c-800a-0c63b50bffd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:27:27 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8828ea5-f3dc-4cb6-a13c-42dfe5489378]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153] added
Aug 09 19:27:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e86105-06dc-46ab-9575-1cc011153313]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4655470-63df-4afe-b352-bf18640fc5ac]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMNZdzcn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMNZdzcn" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b1a192-c097-4ad1-9ce2-dee9f4586298]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMNZdzcn'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a59b9c5-4cb9-4f0e-9cdd-4a0e32cf10c3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609232.8065717, 35cf4c2d-73eb-4973-8fe7-49de92ff46c4 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:27 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] VM Stopped (Lifecycle Event)
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[095cf704-03a9-4d28-8d30-9d325b2edb1b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb35904d-5860-4ea8-b1c5-e3a62ea325be None None] [instance: 35cf4c2d-73eb-4973-8fe7-49de92ff46c4] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5630b8-575e-49de-bdc7-e43607cabdcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260]
Aug 09 19:27:27 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260] successful.
Aug 09 19:27:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[232b7972-c3f7-4435-87a5-7d1796702108]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd109f18-9175-4478-9a5a-ff27b26a592c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49df339-cecd-47c1-ba6f-391c3a1ba7a0 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 (non-flash)
Aug 09 19:27:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c25ec1-2e95-4b68-ba96-79af1a5f106e]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:27:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMNZdzcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing instance network info cache due to event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:28 user nova-compute[72441]: INFO nova.compute.manager [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Rebooting instance
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23135363262626439', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135363262626439', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'flavor' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:27:29 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:27:29 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:27:29 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:27:29 user nova-compute[72441]:   <serial>5c3783b5-e14e-43fb-8502-c3cfb863b153</serial>
Aug 09 19:27:29 user nova-compute[72441]: </disk>
Aug 09 19:27:29 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.network.neutron [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updated VIF entry in instance network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.network.neutron [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9dd66ddf-bd85-450e-a3c7-f393b8c2c121 req-60dbb039-4a90-44a8-8dc9-75abc3510e0a service nova] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No BDM found with device name hda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] No VIF found with MAC fa:16:3e:d4:a5:a9, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-60dc99e7-5350-4aa4-9bc2-3d5a8cf92338 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.116s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609235.4003384, 9993e22d-c00a-497a-bb28-500abdc8a2f3 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:30 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] VM Stopped (Lifecycle Event)
Aug 09 19:27:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cb02710d-09c6-41e0-9ffd-31c97ee875ca None None] [instance: 9993e22d-c00a-497a-bb28-500abdc8a2f3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:31 user nova-compute[72441]: INFO nova.compute.manager [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Detaching volume 5c3783b5-e14e-43fb-8502-c3cfb863b153
Aug 09 19:27:31 user nova-compute[72441]: INFO nova.virt.block_device [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Attempting to driver detach volume 5c3783b5-e14e-43fb-8502-c3cfb863b153 from mountpoint /dev/vdb
Aug 09 19:27:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Attempting to detach device vdb from instance f0c45570-1b41-4666-9fe0-ed489926132b from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:27:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:27:31 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:27:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:27:31 user nova-compute[72441]:   <serial>5c3783b5-e14e-43fb-8502-c3cfb863b153</serial>
Aug 09 19:27:31 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 19:27:31 user nova-compute[72441]: </disk>
Aug 09 19:27:31 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:27:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully detached device vdb from instance f0c45570-1b41-4666-9fe0-ed489926132b from the persistent domain config.
Aug 09 19:27:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0c45570-1b41-4666-9fe0-ed489926132b from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:27:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:27:31 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:27:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:27:31 user nova-compute[72441]:   <serial>5c3783b5-e14e-43fb-8502-c3cfb863b153</serial>
Aug 09 19:27:31 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 19:27:31 user nova-compute[72441]: </disk>
Aug 09 19:27:31 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609251.6917102, f0c45570-1b41-4666-9fe0-ed489926132b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:27:32 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully detached device vdb from instance f0c45570-1b41-4666-9fe0-ed489926132b from the live domain config.
Aug 09 19:27:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:27:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7103MB free_disk=25.182510375976562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMNZdzcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24dec6d-3737-42e9-8618-27ab3a82f4c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb4eaa-9aa7-4d1d-8928-b9cd06542561]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 (non-flash)
Aug 09 19:27:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd906f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39ada5-b66e-405e-a003-6b3e62556516]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad231bf-d5f9-416a-b242-b7f77d65ee28]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbfd750-8be4-4727-951f-d730b7f69b40]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance f0c45570-1b41-4666-9fe0-ed489926132b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a3e55-6dfd-418e-8c1c-fc65b1c53a14]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[428fd26f-160e-4ccc-9e49-94c97a2341ac]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2259228-bde4-469b-aee4-db03e1d69d44]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260]
Aug 09 19:27:32 user nova-compute[72441]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153, portal: 172.16.0.220,3260] successful.
Aug 09 19:27:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c3783b5-e14e-43fb-8502-c3cfb863b153 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e3ba0-f89a-4a0b-a34e-48adbfef50dd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] <== disconnect_volume: return (394ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Starting finish_revert_migration {{(pid=72441) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start _get_guest_xml network_info=[{"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c', 'attached_at': '2023-08-09T19:27:33.000000', 'detached_at': '', 'volume_id': '57bc1d96-f0e4-4eda-bec5-b51a8582e549', 'serial': '57bc1d96-f0e4-4eda-bec5-b51a8582e549'}, 'attachment_id': '4828a8cd-aa4b-4db0-a19c-32ece243618c', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:27:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:27:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-56156763-0747-4fb5-8fde-81bad6fb3ede req-7a1cc509-4ede-4c69-8c31-325a4a995b1a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-unplugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-56156763-0747-4fb5-8fde-81bad6fb3ede req-7a1cc509-4ede-4c69-8c31-325a4a995b1a service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-56156763-0747-4fb5-8fde-81bad6fb3ede req-7a1cc509-4ede-4c69-8c31-325a4a995b1a service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-56156763-0747-4fb5-8fde-81bad6fb3ede req-7a1cc509-4ede-4c69-8c31-325a4a995b1a service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-56156763-0747-4fb5-8fde-81bad6fb3ede req-7a1cc509-4ede-4c69-8c31-325a4a995b1a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-unplugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:32 user nova-compute[72441]: WARNING nova.compute.manager [req-56156763-0747-4fb5-8fde-81bad6fb3ede req-7a1cc509-4ede-4c69-8c31-325a4a995b1a service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-unplugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state active and task_state reboot_started.
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:32 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e967ef16-174c-4328-9463-30e4969ca257]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:27:32 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c75750a-672d-43b8-8977-9eee59f68212]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549] added
Aug 09 19:27:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[07198897-929e-457f-b3b0-3e92516da828]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fb3dbb-fd83-4b8e-8776-7d1bb11b1e5c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heCywOBM {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heCywOBM" returned: 0 in 0.105s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeea4c37-c2f6-476f-a2b1-422375598e1f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heCywOBM'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b11ba7-f4e9-4bec-ad05-e065cd7c4152]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56d58c-35e8-41c2-be79-f4b1cae07eb1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ed3de5-e2a3-4a4e-b0c4-a793d72a2f37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]
Aug 09 19:27:33 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.
Aug 09 19:27:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f980fd-0f80-4149-a36c-d674359f7e67]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a872cd-7175-471f-ba5e-0132f7b59926]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:27:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a13bbb-21a8-46fa-9ca3-3539b22513fb]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609238.3635888, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:33 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Stopped (Lifecycle Event)
Aug 09 19:27:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-bf2a6d0b-f88d-465c-b44a-b519d8e839a1 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance shutdown successfully.
Aug 09 19:27:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'flavor' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-72e4e4aa-e2ee-4258-a979-d4a5b0ee9b85 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.800s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:27:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "interface-f0c45570-1b41-4666-9fe0-ed489926132b-df8ca981-7c71-4d6d-b478-55bc0b60b5dd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "interface-f0c45570-1b41-4666-9fe0-ed489926132b-df8ca981-7c71-4d6d-b478-55bc0b60b5dd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23661376335383666', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661376335383666', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.objects.instance [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'flavor' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:27:34 user nova-compute[72441]:   <uuid>33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</uuid>
Aug 09 19:27:34 user nova-compute[72441]:   <name>instance-00000011</name>
Aug 09 19:27:34 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:27:34 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:27:34 user nova-compute[72441]:   <metadata>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:34 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:27:34 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherB-server-744398493</nova:name>
Aug 09 19:27:34 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:27:32</nova:creationTime>
Aug 09 19:27:34 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:27:34 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:34 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:27:34 user nova-compute[72441]:       <nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:user uuid="de57b5e4f9f54fffa53d91f9a6afd092">tempest-ServerActionsTestOtherB-804828463-project-member</nova:user>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:project uuid="4468899cba1a4bfe8a68af07b58b0a04">tempest-ServerActionsTestOtherB-804828463</nova:project>
Aug 09 19:27:34 user nova-compute[72441]:       </nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:34 user nova-compute[72441]:       <nova:ports>
Aug 09 19:27:34 user nova-compute[72441]:         <nova:port uuid="2cacd5ec-a169-42d7-b356-5878fa2373ed">
Aug 09 19:27:34 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 19:27:34 user nova-compute[72441]:         </nova:port>
Aug 09 19:27:34 user nova-compute[72441]:       </nova:ports>
Aug 09 19:27:34 user nova-compute[72441]:     </nova:instance>
Aug 09 19:27:34 user nova-compute[72441]:   </metadata>
Aug 09 19:27:34 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:27:34 user nova-compute[72441]:     <system>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name="serial">33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name="uuid">33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:27:34 user nova-compute[72441]:     </system>
Aug 09 19:27:34 user nova-compute[72441]:   </sysinfo>
Aug 09 19:27:34 user nova-compute[72441]:   <os>
Aug 09 19:27:34 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:27:34 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:27:34 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:27:34 user nova-compute[72441]:   </os>
Aug 09 19:27:34 user nova-compute[72441]:   <features>
Aug 09 19:27:34 user nova-compute[72441]:     <acpi/>
Aug 09 19:27:34 user nova-compute[72441]:     <apic/>
Aug 09 19:27:34 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:27:34 user nova-compute[72441]:   </features>
Aug 09 19:27:34 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:27:34 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:27:34 user nova-compute[72441]:   </clock>
Aug 09 19:27:34 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:27:34 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:27:34 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:27:34 user nova-compute[72441]:   </cpu>
Aug 09 19:27:34 user nova-compute[72441]:   <devices>
Aug 09 19:27:34 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:27:34 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:27:34 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk"/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:27:34 user nova-compute[72441]:     </disk>
Aug 09 19:27:34 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:27:34 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:27:34 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:27:34 user nova-compute[72441]:       <serial>57bc1d96-f0e4-4eda-bec5-b51a8582e549</serial>
Aug 09 19:27:34 user nova-compute[72441]:     </disk>
Aug 09 19:27:34 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:27:34 user nova-compute[72441]:       <mac address="fa:16:3e:d6:d5:a3"/>
Aug 09 19:27:34 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:27:34 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev="tap2cacd5ec-a1"/>
Aug 09 19:27:34 user nova-compute[72441]:     </interface>
Aug 09 19:27:34 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:27:34 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/console.log" append="off"/>
Aug 09 19:27:34 user nova-compute[72441]:     </serial>
Aug 09 19:27:34 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:27:34 user nova-compute[72441]:     <video>
Aug 09 19:27:34 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:27:34 user nova-compute[72441]:     </video>
Aug 09 19:27:34 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:27:34 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:27:34 user nova-compute[72441]:     </rng>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:27:34 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:27:34 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:27:34 user nova-compute[72441]:     </memballoon>
Aug 09 19:27:34 user nova-compute[72441]:   </devices>
Aug 09 19:27:34 user nova-compute[72441]: </domain>
Aug 09 19:27:34 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG os_vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cacd5ec-a1, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cacd5ec-a1, col_values=(('external_ids', {'iface-id': '2cacd5ec-a169-42d7-b356-5878fa2373ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d5:a3', 'vm-uuid': '33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface> {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface> {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Attempting to detach device tapdf8ca981-7c from instance f0c45570-1b41-4666-9fe0-ed489926132b from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] detach device xml: <interface type="ethernet">
Aug 09 19:27:34 user nova-compute[72441]:   <mac address="fa:16:3e:cd:71:63"/>
Aug 09 19:27:34 user nova-compute[72441]:   <model type="virtio"/>
Aug 09 19:27:34 user nova-compute[72441]:   <mtu size="1442"/>
Aug 09 19:27:34 user nova-compute[72441]:   <target dev="tapdf8ca981-7c"/>
Aug 09 19:27:34 user nova-compute[72441]: </interface>
Aug 09 19:27:34 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: INFO os_vif [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1')
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface> {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface>not found in domain: <domain type='kvm' id='31'>
Aug 09 19:27:34 user nova-compute[72441]:   <name>instance-00000019</name>
Aug 09 19:27:34 user nova-compute[72441]:   <uuid>f0c45570-1b41-4666-9fe0-ed489926132b</uuid>
Aug 09 19:27:34 user nova-compute[72441]:   <metadata>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:34 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:15</nova:creationTime>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:34 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:34 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:34 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:port uuid="df8ca981-7c71-4d6d-b478-55bc0b60b5dd">
Aug 09 19:27:34 user nova-compute[72441]:       <nova:ip type="fixed" address="10.10.10.206" ipVersion="4"/>
Aug 09 19:27:34 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:34 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:34 user nova-compute[72441]:   </metadata>
Aug 09 19:27:34 user nova-compute[72441]:   <memory unit='KiB'>524288</memory>
Aug 09 19:27:34 user nova-compute[72441]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 19:27:34 user nova-compute[72441]:   <vcpu placement='static'>1</vcpu>
Aug 09 19:27:34 user nova-compute[72441]:   <resource>
Aug 09 19:27:34 user nova-compute[72441]:     <partition>/machine</partition>
Aug 09 19:27:34 user nova-compute[72441]:   </resource>
Aug 09 19:27:34 user nova-compute[72441]:   <sysinfo type='smbios'>
Aug 09 19:27:34 user nova-compute[72441]:     <system>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='version'>0.0.0</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='serial'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='uuid'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='family'>Virtual Machine</entry>
Aug 09 19:27:34 user nova-compute[72441]:     </system>
Aug 09 19:27:34 user nova-compute[72441]:   </sysinfo>
Aug 09 19:27:34 user nova-compute[72441]:   <os>
Aug 09 19:27:34 user nova-compute[72441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 19:27:34 user nova-compute[72441]:     <boot dev='hd'/>
Aug 09 19:27:34 user nova-compute[72441]:     <smbios mode='sysinfo'/>
Aug 09 19:27:34 user nova-compute[72441]:   </os>
Aug 09 19:27:34 user nova-compute[72441]:   <features>
Aug 09 19:27:34 user nova-compute[72441]:     <acpi/>
Aug 09 19:27:34 user nova-compute[72441]:     <apic/>
Aug 09 19:27:34 user nova-compute[72441]:     <vmcoreinfo state='on'/>
Aug 09 19:27:34 user nova-compute[72441]:   </features>
Aug 09 19:27:34 user nova-compute[72441]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 19:27:34 user nova-compute[72441]:     <model fallback='forbid'>Nehalem</model>
Aug 09 19:27:34 user nova-compute[72441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 19:27:34 user nova-compute[72441]:     <feature policy='require' name='vme'/>
Aug 09 19:27:34 user nova-compute[72441]:     <feature policy='require' name='x2apic'/>
Aug 09 19:27:34 user nova-compute[72441]:     <feature policy='require' name='hypervisor'/>
Aug 09 19:27:34 user nova-compute[72441]:   </cpu>
Aug 09 19:27:34 user nova-compute[72441]:   <clock offset='utc'>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name='hpet' present='no'/>
Aug 09 19:27:34 user nova-compute[72441]:   </clock>
Aug 09 19:27:34 user nova-compute[72441]:   <on_poweroff>destroy</on_poweroff>
Aug 09 19:27:34 user nova-compute[72441]:   <on_reboot>restart</on_reboot>
Aug 09 19:27:34 user nova-compute[72441]:   <on_crash>destroy</on_crash>
Aug 09 19:27:34 user nova-compute[72441]:   <devices>
Aug 09 19:27:34 user nova-compute[72441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 19:27:34 user nova-compute[72441]:     <disk type='file' device='disk'>
Aug 09 19:27:34 user nova-compute[72441]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 19:27:34 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk' index='2'/>
Aug 09 19:27:34 user nova-compute[72441]:       <backingStore type='file' index='3'>
Aug 09 19:27:34 user nova-compute[72441]:         <format type='raw'/>
Aug 09 19:27:34 user nova-compute[72441]:         <source file='/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241'/>
Aug 09 19:27:34 user nova-compute[72441]:         <backingStore/>
Aug 09 19:27:34 user nova-compute[72441]:       </backingStore>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='vda' bus='virtio'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='virtio-disk0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </disk>
Aug 09 19:27:34 user nova-compute[72441]:     <disk type='file' device='cdrom'>
Aug 09 19:27:34 user nova-compute[72441]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 19:27:34 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config' index='1'/>
Aug 09 19:27:34 user nova-compute[72441]:       <backingStore/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='hda' bus='ide'/>
Aug 09 19:27:34 user nova-compute[72441]:       <readonly/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='ide0-0-0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </disk>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type='usb' index='0' model='none'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='usb'/>
Aug 09 19:27:34 user nova-compute[72441]:     </controller>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='pci.0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </controller>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type='ide' index='0'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='ide'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 19:27:34 user nova-compute[72441]:     </controller>
Aug 09 19:27:34 user nova-compute[72441]:     <interface type='ethernet'>
Aug 09 19:27:34 user nova-compute[72441]:       <mac address='fa:16:3e:d4:a5:a9'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='tapf88a4415-bd'/>
Aug 09 19:27:34 user nova-compute[72441]:       <model type='virtio'/>
Aug 09 19:27:34 user nova-compute[72441]:       <mtu size='1442'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='net0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </interface>
Aug 09 19:27:34 user nova-compute[72441]:     <interface type='ethernet'>
Aug 09 19:27:34 user nova-compute[72441]:       <mac address='fa:16:3e:cd:71:63'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='tapdf8ca981-7c'/>
Aug 09 19:27:34 user nova-compute[72441]:       <model type='virtio'/>
Aug 09 19:27:34 user nova-compute[72441]:       <mtu size='1442'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='net1'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </interface>
Aug 09 19:27:34 user nova-compute[72441]:     <serial type='pty'>
Aug 09 19:27:34 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:34 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target type='isa-serial' port='0'>
Aug 09 19:27:34 user nova-compute[72441]:         <model name='isa-serial'/>
Aug 09 19:27:34 user nova-compute[72441]:       </target>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </serial>
Aug 09 19:27:34 user nova-compute[72441]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 19:27:34 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:34 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target type='serial' port='0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </console>
Aug 09 19:27:34 user nova-compute[72441]:     <input type='mouse' bus='ps2'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='input0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </input>
Aug 09 19:27:34 user nova-compute[72441]:     <input type='keyboard' bus='ps2'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='input1'/>
Aug 09 19:27:34 user nova-compute[72441]:     </input>
Aug 09 19:27:34 user nova-compute[72441]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 19:27:34 user nova-compute[72441]:       <listen type='address' address='0.0.0.0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </graphics>
Aug 09 19:27:34 user nova-compute[72441]:     <audio id='1' type='none'/>
Aug 09 19:27:34 user nova-compute[72441]:     <video>
Aug 09 19:27:34 user nova-compute[72441]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='video0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </video>
Aug 09 19:27:34 user nova-compute[72441]:     <memballoon model='virtio'>
Aug 09 19:27:34 user nova-compute[72441]:       <stats period='10'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='balloon0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </memballoon>
Aug 09 19:27:34 user nova-compute[72441]:     <rng model='virtio'>
Aug 09 19:27:34 user nova-compute[72441]:       <backend model='random'>/dev/urandom</backend>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='rng0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </rng>
Aug 09 19:27:34 user nova-compute[72441]:   </devices>
Aug 09 19:27:34 user nova-compute[72441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 19:27:34 user nova-compute[72441]:     <label>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</label>
Aug 09 19:27:34 user nova-compute[72441]:     <imagelabel>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</imagelabel>
Aug 09 19:27:34 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:34 user nova-compute[72441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 19:27:34 user nova-compute[72441]:     <label>+64055:+108</label>
Aug 09 19:27:34 user nova-compute[72441]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 19:27:34 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:34 user nova-compute[72441]: </domain>
Aug 09 19:27:34 user nova-compute[72441]:  {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 19:27:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully detached device tapdf8ca981-7c from instance f0c45570-1b41-4666-9fe0-ed489926132b from the persistent domain config.
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] (1/8): Attempting to detach device tapdf8ca981-7c with device alias net1 from instance f0c45570-1b41-4666-9fe0-ed489926132b from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] detach device xml: <interface type="ethernet">
Aug 09 19:27:34 user nova-compute[72441]:   <mac address="fa:16:3e:cd:71:63"/>
Aug 09 19:27:34 user nova-compute[72441]:   <model type="virtio"/>
Aug 09 19:27:34 user nova-compute[72441]:   <mtu size="1442"/>
Aug 09 19:27:34 user nova-compute[72441]:   <target dev="tapdf8ca981-7c"/>
Aug 09 19:27:34 user nova-compute[72441]: </interface>
Aug 09 19:27:34 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:27:34 user nova-compute[72441]: INFO nova.compute.manager [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Rescuing
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609254.80054, f0c45570-1b41-4666-9fe0-ed489926132b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Start waiting for the detach event from libvirt for device tapdf8ca981-7c with device alias net1 for instance f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface> {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface>not found in domain: <domain type='kvm' id='31'>
Aug 09 19:27:34 user nova-compute[72441]:   <name>instance-00000019</name>
Aug 09 19:27:34 user nova-compute[72441]:   <uuid>f0c45570-1b41-4666-9fe0-ed489926132b</uuid>
Aug 09 19:27:34 user nova-compute[72441]:   <metadata>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:34 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:15</nova:creationTime>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:34 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:34 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:34 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:port uuid="df8ca981-7c71-4d6d-b478-55bc0b60b5dd">
Aug 09 19:27:34 user nova-compute[72441]:       <nova:ip type="fixed" address="10.10.10.206" ipVersion="4"/>
Aug 09 19:27:34 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:34 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:34 user nova-compute[72441]:   </metadata>
Aug 09 19:27:34 user nova-compute[72441]:   <memory unit='KiB'>524288</memory>
Aug 09 19:27:34 user nova-compute[72441]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 19:27:34 user nova-compute[72441]:   <vcpu placement='static'>1</vcpu>
Aug 09 19:27:34 user nova-compute[72441]:   <resource>
Aug 09 19:27:34 user nova-compute[72441]:     <partition>/machine</partition>
Aug 09 19:27:34 user nova-compute[72441]:   </resource>
Aug 09 19:27:34 user nova-compute[72441]:   <sysinfo type='smbios'>
Aug 09 19:27:34 user nova-compute[72441]:     <system>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='version'>0.0.0</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='serial'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='uuid'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:34 user nova-compute[72441]:       <entry name='family'>Virtual Machine</entry>
Aug 09 19:27:34 user nova-compute[72441]:     </system>
Aug 09 19:27:34 user nova-compute[72441]:   </sysinfo>
Aug 09 19:27:34 user nova-compute[72441]:   <os>
Aug 09 19:27:34 user nova-compute[72441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 19:27:34 user nova-compute[72441]:     <boot dev='hd'/>
Aug 09 19:27:34 user nova-compute[72441]:     <smbios mode='sysinfo'/>
Aug 09 19:27:34 user nova-compute[72441]:   </os>
Aug 09 19:27:34 user nova-compute[72441]:   <features>
Aug 09 19:27:34 user nova-compute[72441]:     <acpi/>
Aug 09 19:27:34 user nova-compute[72441]:     <apic/>
Aug 09 19:27:34 user nova-compute[72441]:     <vmcoreinfo state='on'/>
Aug 09 19:27:34 user nova-compute[72441]:   </features>
Aug 09 19:27:34 user nova-compute[72441]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 19:27:34 user nova-compute[72441]:     <model fallback='forbid'>Nehalem</model>
Aug 09 19:27:34 user nova-compute[72441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 19:27:34 user nova-compute[72441]:     <feature policy='require' name='vme'/>
Aug 09 19:27:34 user nova-compute[72441]:     <feature policy='require' name='x2apic'/>
Aug 09 19:27:34 user nova-compute[72441]:     <feature policy='require' name='hypervisor'/>
Aug 09 19:27:34 user nova-compute[72441]:   </cpu>
Aug 09 19:27:34 user nova-compute[72441]:   <clock offset='utc'>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 19:27:34 user nova-compute[72441]:     <timer name='hpet' present='no'/>
Aug 09 19:27:34 user nova-compute[72441]:   </clock>
Aug 09 19:27:34 user nova-compute[72441]:   <on_poweroff>destroy</on_poweroff>
Aug 09 19:27:34 user nova-compute[72441]:   <on_reboot>restart</on_reboot>
Aug 09 19:27:34 user nova-compute[72441]:   <on_crash>destroy</on_crash>
Aug 09 19:27:34 user nova-compute[72441]:   <devices>
Aug 09 19:27:34 user nova-compute[72441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 19:27:34 user nova-compute[72441]:     <disk type='file' device='disk'>
Aug 09 19:27:34 user nova-compute[72441]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 19:27:34 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk' index='2'/>
Aug 09 19:27:34 user nova-compute[72441]:       <backingStore type='file' index='3'>
Aug 09 19:27:34 user nova-compute[72441]:         <format type='raw'/>
Aug 09 19:27:34 user nova-compute[72441]:         <source file='/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241'/>
Aug 09 19:27:34 user nova-compute[72441]:         <backingStore/>
Aug 09 19:27:34 user nova-compute[72441]:       </backingStore>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='vda' bus='virtio'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='virtio-disk0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </disk>
Aug 09 19:27:34 user nova-compute[72441]:     <disk type='file' device='cdrom'>
Aug 09 19:27:34 user nova-compute[72441]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 19:27:34 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config' index='1'/>
Aug 09 19:27:34 user nova-compute[72441]:       <backingStore/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='hda' bus='ide'/>
Aug 09 19:27:34 user nova-compute[72441]:       <readonly/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='ide0-0-0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </disk>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type='usb' index='0' model='none'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='usb'/>
Aug 09 19:27:34 user nova-compute[72441]:     </controller>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='pci.0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </controller>
Aug 09 19:27:34 user nova-compute[72441]:     <controller type='ide' index='0'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='ide'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 19:27:34 user nova-compute[72441]:     </controller>
Aug 09 19:27:34 user nova-compute[72441]:     <interface type='ethernet'>
Aug 09 19:27:34 user nova-compute[72441]:       <mac address='fa:16:3e:d4:a5:a9'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target dev='tapf88a4415-bd'/>
Aug 09 19:27:34 user nova-compute[72441]:       <model type='virtio'/>
Aug 09 19:27:34 user nova-compute[72441]:       <mtu size='1442'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='net0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </interface>
Aug 09 19:27:34 user nova-compute[72441]:     <serial type='pty'>
Aug 09 19:27:34 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:34 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target type='isa-serial' port='0'>
Aug 09 19:27:34 user nova-compute[72441]:         <model name='isa-serial'/>
Aug 09 19:27:34 user nova-compute[72441]:       </target>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </serial>
Aug 09 19:27:34 user nova-compute[72441]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 19:27:34 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:34 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:34 user nova-compute[72441]:       <target type='serial' port='0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </console>
Aug 09 19:27:34 user nova-compute[72441]:     <input type='mouse' bus='ps2'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='input0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </input>
Aug 09 19:27:34 user nova-compute[72441]:     <input type='keyboard' bus='ps2'>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='input1'/>
Aug 09 19:27:34 user nova-compute[72441]:     </input>
Aug 09 19:27:34 user nova-compute[72441]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 19:27:34 user nova-compute[72441]:       <listen type='address' address='0.0.0.0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </graphics>
Aug 09 19:27:34 user nova-compute[72441]:     <audio id='1' type='none'/>
Aug 09 19:27:34 user nova-compute[72441]:     <video>
Aug 09 19:27:34 user nova-compute[72441]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='video0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </video>
Aug 09 19:27:34 user nova-compute[72441]:     <memballoon model='virtio'>
Aug 09 19:27:34 user nova-compute[72441]:       <stats period='10'/>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='balloon0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </memballoon>
Aug 09 19:27:34 user nova-compute[72441]:     <rng model='virtio'>
Aug 09 19:27:34 user nova-compute[72441]:       <backend model='random'>/dev/urandom</backend>
Aug 09 19:27:34 user nova-compute[72441]:       <alias name='rng0'/>
Aug 09 19:27:34 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 19:27:34 user nova-compute[72441]:     </rng>
Aug 09 19:27:34 user nova-compute[72441]:   </devices>
Aug 09 19:27:34 user nova-compute[72441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 19:27:34 user nova-compute[72441]:     <label>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</label>
Aug 09 19:27:34 user nova-compute[72441]:     <imagelabel>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</imagelabel>
Aug 09 19:27:34 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:34 user nova-compute[72441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 19:27:34 user nova-compute[72441]:     <label>+64055:+108</label>
Aug 09 19:27:34 user nova-compute[72441]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 19:27:34 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:34 user nova-compute[72441]: </domain>
Aug 09 19:27:34 user nova-compute[72441]:  {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 19:27:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully detached device tapdf8ca981-7c from instance f0c45570-1b41-4666-9fe0-ed489926132b from the live domain config.
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG os_vif [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf8ca981-7c, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:34 user nova-compute[72441]: INFO os_vif [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c')
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:34 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:34</nova:creationTime>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:34 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:34 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:34 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:34 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:34 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:34 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:34 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:34 user nova-compute[72441]:  {{(pid=72441) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-6acdeaa3-fcb1-42e3-abaf-6a7da4157816 req-5e8489e2-6b9c-4eaf-9703-9167a77f96e9 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6acdeaa3-fcb1-42e3-abaf-6a7da4157816 req-5e8489e2-6b9c-4eaf-9703-9167a77f96e9 service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6acdeaa3-fcb1-42e3-abaf-6a7da4157816 req-5e8489e2-6b9c-4eaf-9703-9167a77f96e9 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6acdeaa3-fcb1-42e3-abaf-6a7da4157816 req-5e8489e2-6b9c-4eaf-9703-9167a77f96e9 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-6acdeaa3-fcb1-42e3-abaf-6a7da4157816 req-5e8489e2-6b9c-4eaf-9703-9167a77f96e9 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:34 user nova-compute[72441]: WARNING nova.compute.manager [req-6acdeaa3-fcb1-42e3-abaf-6a7da4157816 req-5e8489e2-6b9c-4eaf-9703-9167a77f96e9 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state active and task_state reboot_started.
Aug 09 19:27:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG nova.network.neutron [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-deleted-df8ca981-7c71-4d6d-b478-55bc0b60b5dd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:35 user nova-compute[72441]: INFO nova.compute.manager [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Neutron deleted interface df8ca981-7c71-4d6d-b478-55bc0b60b5dd; detaching it from the instance and deleting it from the info cache
Aug 09 19:27:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG nova.objects.instance [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Lazy-loading 'system_metadata' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquired lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:35 user nova-compute[72441]: DEBUG nova.network.neutron [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.objects.instance [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Lazy-loading 'flavor' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.network.os_vif_util [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Converting VIF {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.network.os_vif_util [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface> {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface>not found in domain: <domain type='kvm' id='31'>
Aug 09 19:27:36 user nova-compute[72441]:   <name>instance-00000019</name>
Aug 09 19:27:36 user nova-compute[72441]:   <uuid>f0c45570-1b41-4666-9fe0-ed489926132b</uuid>
Aug 09 19:27:36 user nova-compute[72441]:   <metadata>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:36 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:34</nova:creationTime>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:36 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:36 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:36 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:36 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:36 user nova-compute[72441]:   </metadata>
Aug 09 19:27:36 user nova-compute[72441]:   <memory unit='KiB'>524288</memory>
Aug 09 19:27:36 user nova-compute[72441]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 19:27:36 user nova-compute[72441]:   <vcpu placement='static'>1</vcpu>
Aug 09 19:27:36 user nova-compute[72441]:   <resource>
Aug 09 19:27:36 user nova-compute[72441]:     <partition>/machine</partition>
Aug 09 19:27:36 user nova-compute[72441]:   </resource>
Aug 09 19:27:36 user nova-compute[72441]:   <sysinfo type='smbios'>
Aug 09 19:27:36 user nova-compute[72441]:     <system>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='version'>0.0.0</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='serial'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='uuid'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='family'>Virtual Machine</entry>
Aug 09 19:27:36 user nova-compute[72441]:     </system>
Aug 09 19:27:36 user nova-compute[72441]:   </sysinfo>
Aug 09 19:27:36 user nova-compute[72441]:   <os>
Aug 09 19:27:36 user nova-compute[72441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 19:27:36 user nova-compute[72441]:     <boot dev='hd'/>
Aug 09 19:27:36 user nova-compute[72441]:     <smbios mode='sysinfo'/>
Aug 09 19:27:36 user nova-compute[72441]:   </os>
Aug 09 19:27:36 user nova-compute[72441]:   <features>
Aug 09 19:27:36 user nova-compute[72441]:     <acpi/>
Aug 09 19:27:36 user nova-compute[72441]:     <apic/>
Aug 09 19:27:36 user nova-compute[72441]:     <vmcoreinfo state='on'/>
Aug 09 19:27:36 user nova-compute[72441]:   </features>
Aug 09 19:27:36 user nova-compute[72441]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 19:27:36 user nova-compute[72441]:     <model fallback='forbid'>Nehalem</model>
Aug 09 19:27:36 user nova-compute[72441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 19:27:36 user nova-compute[72441]:     <feature policy='require' name='vme'/>
Aug 09 19:27:36 user nova-compute[72441]:     <feature policy='require' name='x2apic'/>
Aug 09 19:27:36 user nova-compute[72441]:     <feature policy='require' name='hypervisor'/>
Aug 09 19:27:36 user nova-compute[72441]:   </cpu>
Aug 09 19:27:36 user nova-compute[72441]:   <clock offset='utc'>
Aug 09 19:27:36 user nova-compute[72441]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 19:27:36 user nova-compute[72441]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 19:27:36 user nova-compute[72441]:     <timer name='hpet' present='no'/>
Aug 09 19:27:36 user nova-compute[72441]:   </clock>
Aug 09 19:27:36 user nova-compute[72441]:   <on_poweroff>destroy</on_poweroff>
Aug 09 19:27:36 user nova-compute[72441]:   <on_reboot>restart</on_reboot>
Aug 09 19:27:36 user nova-compute[72441]:   <on_crash>destroy</on_crash>
Aug 09 19:27:36 user nova-compute[72441]:   <devices>
Aug 09 19:27:36 user nova-compute[72441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 19:27:36 user nova-compute[72441]:     <disk type='file' device='disk'>
Aug 09 19:27:36 user nova-compute[72441]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 19:27:36 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk' index='2'/>
Aug 09 19:27:36 user nova-compute[72441]:       <backingStore type='file' index='3'>
Aug 09 19:27:36 user nova-compute[72441]:         <format type='raw'/>
Aug 09 19:27:36 user nova-compute[72441]:         <source file='/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241'/>
Aug 09 19:27:36 user nova-compute[72441]:         <backingStore/>
Aug 09 19:27:36 user nova-compute[72441]:       </backingStore>
Aug 09 19:27:36 user nova-compute[72441]:       <target dev='vda' bus='virtio'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='virtio-disk0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </disk>
Aug 09 19:27:36 user nova-compute[72441]:     <disk type='file' device='cdrom'>
Aug 09 19:27:36 user nova-compute[72441]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 19:27:36 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config' index='1'/>
Aug 09 19:27:36 user nova-compute[72441]:       <backingStore/>
Aug 09 19:27:36 user nova-compute[72441]:       <target dev='hda' bus='ide'/>
Aug 09 19:27:36 user nova-compute[72441]:       <readonly/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='ide0-0-0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </disk>
Aug 09 19:27:36 user nova-compute[72441]:     <controller type='usb' index='0' model='none'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='usb'/>
Aug 09 19:27:36 user nova-compute[72441]:     </controller>
Aug 09 19:27:36 user nova-compute[72441]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='pci.0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </controller>
Aug 09 19:27:36 user nova-compute[72441]:     <controller type='ide' index='0'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='ide'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 19:27:36 user nova-compute[72441]:     </controller>
Aug 09 19:27:36 user nova-compute[72441]:     <interface type='ethernet'>
Aug 09 19:27:36 user nova-compute[72441]:       <mac address='fa:16:3e:d4:a5:a9'/>
Aug 09 19:27:36 user nova-compute[72441]:       <target dev='tapf88a4415-bd'/>
Aug 09 19:27:36 user nova-compute[72441]:       <model type='virtio'/>
Aug 09 19:27:36 user nova-compute[72441]:       <mtu size='1442'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='net0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </interface>
Aug 09 19:27:36 user nova-compute[72441]:     <serial type='pty'>
Aug 09 19:27:36 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:36 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:36 user nova-compute[72441]:       <target type='isa-serial' port='0'>
Aug 09 19:27:36 user nova-compute[72441]:         <model name='isa-serial'/>
Aug 09 19:27:36 user nova-compute[72441]:       </target>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </serial>
Aug 09 19:27:36 user nova-compute[72441]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 19:27:36 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:36 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:36 user nova-compute[72441]:       <target type='serial' port='0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </console>
Aug 09 19:27:36 user nova-compute[72441]:     <input type='mouse' bus='ps2'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='input0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </input>
Aug 09 19:27:36 user nova-compute[72441]:     <input type='keyboard' bus='ps2'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='input1'/>
Aug 09 19:27:36 user nova-compute[72441]:     </input>
Aug 09 19:27:36 user nova-compute[72441]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 19:27:36 user nova-compute[72441]:       <listen type='address' address='0.0.0.0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </graphics>
Aug 09 19:27:36 user nova-compute[72441]:     <audio id='1' type='none'/>
Aug 09 19:27:36 user nova-compute[72441]:     <video>
Aug 09 19:27:36 user nova-compute[72441]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='video0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </video>
Aug 09 19:27:36 user nova-compute[72441]:     <memballoon model='virtio'>
Aug 09 19:27:36 user nova-compute[72441]:       <stats period='10'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='balloon0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </memballoon>
Aug 09 19:27:36 user nova-compute[72441]:     <rng model='virtio'>
Aug 09 19:27:36 user nova-compute[72441]:       <backend model='random'>/dev/urandom</backend>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='rng0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </rng>
Aug 09 19:27:36 user nova-compute[72441]:   </devices>
Aug 09 19:27:36 user nova-compute[72441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 19:27:36 user nova-compute[72441]:     <label>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</label>
Aug 09 19:27:36 user nova-compute[72441]:     <imagelabel>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</imagelabel>
Aug 09 19:27:36 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:36 user nova-compute[72441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 19:27:36 user nova-compute[72441]:     <label>+64055:+108</label>
Aug 09 19:27:36 user nova-compute[72441]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 19:27:36 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:36 user nova-compute[72441]: </domain>
Aug 09 19:27:36 user nova-compute[72441]:  {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface> {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:71:63"/><model type="virtio"/><mtu size="1442"/><target dev="tapdf8ca981-7c"/></interface>not found in domain: <domain type='kvm' id='31'>
Aug 09 19:27:36 user nova-compute[72441]:   <name>instance-00000019</name>
Aug 09 19:27:36 user nova-compute[72441]:   <uuid>f0c45570-1b41-4666-9fe0-ed489926132b</uuid>
Aug 09 19:27:36 user nova-compute[72441]:   <metadata>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:36 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:34</nova:creationTime>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:36 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:36 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:36 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:36 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:36 user nova-compute[72441]:   </metadata>
Aug 09 19:27:36 user nova-compute[72441]:   <memory unit='KiB'>524288</memory>
Aug 09 19:27:36 user nova-compute[72441]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 19:27:36 user nova-compute[72441]:   <vcpu placement='static'>1</vcpu>
Aug 09 19:27:36 user nova-compute[72441]:   <resource>
Aug 09 19:27:36 user nova-compute[72441]:     <partition>/machine</partition>
Aug 09 19:27:36 user nova-compute[72441]:   </resource>
Aug 09 19:27:36 user nova-compute[72441]:   <sysinfo type='smbios'>
Aug 09 19:27:36 user nova-compute[72441]:     <system>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='version'>0.0.0</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='serial'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='uuid'>f0c45570-1b41-4666-9fe0-ed489926132b</entry>
Aug 09 19:27:36 user nova-compute[72441]:       <entry name='family'>Virtual Machine</entry>
Aug 09 19:27:36 user nova-compute[72441]:     </system>
Aug 09 19:27:36 user nova-compute[72441]:   </sysinfo>
Aug 09 19:27:36 user nova-compute[72441]:   <os>
Aug 09 19:27:36 user nova-compute[72441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 19:27:36 user nova-compute[72441]:     <boot dev='hd'/>
Aug 09 19:27:36 user nova-compute[72441]:     <smbios mode='sysinfo'/>
Aug 09 19:27:36 user nova-compute[72441]:   </os>
Aug 09 19:27:36 user nova-compute[72441]:   <features>
Aug 09 19:27:36 user nova-compute[72441]:     <acpi/>
Aug 09 19:27:36 user nova-compute[72441]:     <apic/>
Aug 09 19:27:36 user nova-compute[72441]:     <vmcoreinfo state='on'/>
Aug 09 19:27:36 user nova-compute[72441]:   </features>
Aug 09 19:27:36 user nova-compute[72441]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 19:27:36 user nova-compute[72441]:     <model fallback='forbid'>Nehalem</model>
Aug 09 19:27:36 user nova-compute[72441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 19:27:36 user nova-compute[72441]:     <feature policy='require' name='vme'/>
Aug 09 19:27:36 user nova-compute[72441]:     <feature policy='require' name='x2apic'/>
Aug 09 19:27:36 user nova-compute[72441]:     <feature policy='require' name='hypervisor'/>
Aug 09 19:27:36 user nova-compute[72441]:   </cpu>
Aug 09 19:27:36 user nova-compute[72441]:   <clock offset='utc'>
Aug 09 19:27:36 user nova-compute[72441]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 19:27:36 user nova-compute[72441]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 19:27:36 user nova-compute[72441]:     <timer name='hpet' present='no'/>
Aug 09 19:27:36 user nova-compute[72441]:   </clock>
Aug 09 19:27:36 user nova-compute[72441]:   <on_poweroff>destroy</on_poweroff>
Aug 09 19:27:36 user nova-compute[72441]:   <on_reboot>restart</on_reboot>
Aug 09 19:27:36 user nova-compute[72441]:   <on_crash>destroy</on_crash>
Aug 09 19:27:36 user nova-compute[72441]:   <devices>
Aug 09 19:27:36 user nova-compute[72441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 19:27:36 user nova-compute[72441]:     <disk type='file' device='disk'>
Aug 09 19:27:36 user nova-compute[72441]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 19:27:36 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk' index='2'/>
Aug 09 19:27:36 user nova-compute[72441]:       <backingStore type='file' index='3'>
Aug 09 19:27:36 user nova-compute[72441]:         <format type='raw'/>
Aug 09 19:27:36 user nova-compute[72441]:         <source file='/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241'/>
Aug 09 19:27:36 user nova-compute[72441]:         <backingStore/>
Aug 09 19:27:36 user nova-compute[72441]:       </backingStore>
Aug 09 19:27:36 user nova-compute[72441]:       <target dev='vda' bus='virtio'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='virtio-disk0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </disk>
Aug 09 19:27:36 user nova-compute[72441]:     <disk type='file' device='cdrom'>
Aug 09 19:27:36 user nova-compute[72441]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 19:27:36 user nova-compute[72441]:       <source file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/disk.config' index='1'/>
Aug 09 19:27:36 user nova-compute[72441]:       <backingStore/>
Aug 09 19:27:36 user nova-compute[72441]:       <target dev='hda' bus='ide'/>
Aug 09 19:27:36 user nova-compute[72441]:       <readonly/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='ide0-0-0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </disk>
Aug 09 19:27:36 user nova-compute[72441]:     <controller type='usb' index='0' model='none'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='usb'/>
Aug 09 19:27:36 user nova-compute[72441]:     </controller>
Aug 09 19:27:36 user nova-compute[72441]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='pci.0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </controller>
Aug 09 19:27:36 user nova-compute[72441]:     <controller type='ide' index='0'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='ide'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 19:27:36 user nova-compute[72441]:     </controller>
Aug 09 19:27:36 user nova-compute[72441]:     <interface type='ethernet'>
Aug 09 19:27:36 user nova-compute[72441]:       <mac address='fa:16:3e:d4:a5:a9'/>
Aug 09 19:27:36 user nova-compute[72441]:       <target dev='tapf88a4415-bd'/>
Aug 09 19:27:36 user nova-compute[72441]:       <model type='virtio'/>
Aug 09 19:27:36 user nova-compute[72441]:       <mtu size='1442'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='net0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </interface>
Aug 09 19:27:36 user nova-compute[72441]:     <serial type='pty'>
Aug 09 19:27:36 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:36 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:36 user nova-compute[72441]:       <target type='isa-serial' port='0'>
Aug 09 19:27:36 user nova-compute[72441]:         <model name='isa-serial'/>
Aug 09 19:27:36 user nova-compute[72441]:       </target>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </serial>
Aug 09 19:27:36 user nova-compute[72441]:     <console type='pty' tty='/dev/pts/8'>
Aug 09 19:27:36 user nova-compute[72441]:       <source path='/dev/pts/8'/>
Aug 09 19:27:36 user nova-compute[72441]:       <log file='/opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b/console.log' append='off'/>
Aug 09 19:27:36 user nova-compute[72441]:       <target type='serial' port='0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='serial0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </console>
Aug 09 19:27:36 user nova-compute[72441]:     <input type='mouse' bus='ps2'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='input0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </input>
Aug 09 19:27:36 user nova-compute[72441]:     <input type='keyboard' bus='ps2'>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='input1'/>
Aug 09 19:27:36 user nova-compute[72441]:     </input>
Aug 09 19:27:36 user nova-compute[72441]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 19:27:36 user nova-compute[72441]:       <listen type='address' address='0.0.0.0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </graphics>
Aug 09 19:27:36 user nova-compute[72441]:     <audio id='1' type='none'/>
Aug 09 19:27:36 user nova-compute[72441]:     <video>
Aug 09 19:27:36 user nova-compute[72441]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='video0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </video>
Aug 09 19:27:36 user nova-compute[72441]:     <memballoon model='virtio'>
Aug 09 19:27:36 user nova-compute[72441]:       <stats period='10'/>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='balloon0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </memballoon>
Aug 09 19:27:36 user nova-compute[72441]:     <rng model='virtio'>
Aug 09 19:27:36 user nova-compute[72441]:       <backend model='random'>/dev/urandom</backend>
Aug 09 19:27:36 user nova-compute[72441]:       <alias name='rng0'/>
Aug 09 19:27:36 user nova-compute[72441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 19:27:36 user nova-compute[72441]:     </rng>
Aug 09 19:27:36 user nova-compute[72441]:   </devices>
Aug 09 19:27:36 user nova-compute[72441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 19:27:36 user nova-compute[72441]:     <label>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</label>
Aug 09 19:27:36 user nova-compute[72441]:     <imagelabel>libvirt-f0c45570-1b41-4666-9fe0-ed489926132b</imagelabel>
Aug 09 19:27:36 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:36 user nova-compute[72441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 19:27:36 user nova-compute[72441]:     <label>+64055:+108</label>
Aug 09 19:27:36 user nova-compute[72441]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 19:27:36 user nova-compute[72441]:   </seclabel>
Aug 09 19:27:36 user nova-compute[72441]: </domain>
Aug 09 19:27:36 user nova-compute[72441]:  {{(pid=72441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 19:27:36 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Detaching interface fa:16:3e:cd:71:63 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapdf8ca981-7c' not found.
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.network.os_vif_util [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Converting VIF {"id": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "address": "fa:16:3e:cd:71:63", "network": {"id": "589c1056-27fd-4e47-9e9e-15e4b9965661", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-253669611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8ca981-7c", "ovs_interfaceid": "df8ca981-7c71-4d6d-b478-55bc0b60b5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.network.os_vif_util [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG os_vif [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf8ca981-7c, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:27:36 user nova-compute[72441]: INFO os_vif [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:71:63,bridge_name='br-int',has_traffic_filtering=True,id=df8ca981-7c71-4d6d-b478-55bc0b60b5dd,network=Network(589c1056-27fd-4e47-9e9e-15e4b9965661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8ca981-7c')
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [req-9a2d5fa2-72fb-468f-bca3-2116e2e8b922 req-b5a25de1-8dca-48c1-86b8-b7bd4da5fcd5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:36 user nova-compute[72441]:   <nova:package version="0.0.0"/>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:name>tempest-device-tagging-server-1418015898</nova:name>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:creationTime>2023-08-09 19:27:36</nova:creationTime>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:flavor name="m1.tiny">
Aug 09 19:27:36 user nova-compute[72441]:     <nova:memory>512</nova:memory>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:disk>1</nova:disk>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:swap>0</nova:swap>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:flavor>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:owner>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:user uuid="0f208845e39d41c5b4a2b76748c8e658">tempest-TaggedAttachmentsTest-1198161654-project-member</nova:user>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:project uuid="57335007b06a45ad9f91aa03555d5428">tempest-TaggedAttachmentsTest-1198161654</nova:project>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:owner>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:36 user nova-compute[72441]:   <nova:ports>
Aug 09 19:27:36 user nova-compute[72441]:     <nova:port uuid="f88a4415-bd67-4929-be84-66c1fdee068e">
Aug 09 19:27:36 user nova-compute[72441]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:27:36 user nova-compute[72441]:     </nova:port>
Aug 09 19:27:36 user nova-compute[72441]:   </nova:ports>
Aug 09 19:27:36 user nova-compute[72441]: </nova:instance>
Aug 09 19:27:36 user nova-compute[72441]:  {{(pid=72441) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.network.neutron [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [{"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Releasing lock "refresh_cache-f0c45570-1b41-4666-9fe0-ed489926132b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-887f14ec-80f7-46d3-b6f9-180ba8e0cea0 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "interface-f0c45570-1b41-4666-9fe0-ed489926132b-df8ca981-7c71-4d6d-b478-55bc0b60b5dd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.292s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance destroyed successfully.
Aug 09 19:27:36 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Attempting rescue
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:27:36 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Creating image(s)
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'trusted_certs' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:37 user nova-compute[72441]: WARNING nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state active and task_state reboot_started.
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:37 user nova-compute[72441]: WARNING nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state active and task_state reboot_started.
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:37 user nova-compute[72441]: WARNING nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state active and task_state rescuing.
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:37 user nova-compute[72441]: WARNING nova.compute.manager [req-89e1bb98-45cb-45e6-a24d-4ec9881c8477 req-73ed691a-aec6-40d5-bb22-ae3993212517 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state active and task_state rescuing.
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue" returned: 0 in 0.063s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'migration_context' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Start _get_guest_xml network_info=[{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:e7:08:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'resources' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'numa_topology' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:27:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'vcpu_model' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-528314346',display_name='tempest-ServerRescueNegativeTestJSON-server-528314346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-528314346',id=20,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:22:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-p9iy01kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:22:56Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=e30cf305-f264-4aab-a4cf-f555a57e8db3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:e7:08:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:e7:08:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'pci_devices' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:27:37 user nova-compute[72441]:   <uuid>e30cf305-f264-4aab-a4cf-f555a57e8db3</uuid>
Aug 09 19:27:37 user nova-compute[72441]:   <name>instance-00000014</name>
Aug 09 19:27:37 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:27:37 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:27:37 user nova-compute[72441]:   <metadata>
Aug 09 19:27:37 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:27:37 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:27:37 user nova-compute[72441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-528314346</nova:name>
Aug 09 19:27:37 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:27:37</nova:creationTime>
Aug 09 19:27:37 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:27:37 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:27:37 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:27:37 user nova-compute[72441]:       <nova:owner>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:user uuid="3bdbd35f8a0d4f3297acb453e3109176">tempest-ServerRescueNegativeTestJSON-1340711293-project-member</nova:user>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:project uuid="6dcefc0bffad468b82ae957092668524">tempest-ServerRescueNegativeTestJSON-1340711293</nova:project>
Aug 09 19:27:37 user nova-compute[72441]:       </nova:owner>
Aug 09 19:27:37 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:27:37 user nova-compute[72441]:       <nova:ports>
Aug 09 19:27:37 user nova-compute[72441]:         <nova:port uuid="9c11f350-193b-4573-828c-1c72e7effd21">
Aug 09 19:27:37 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:27:37 user nova-compute[72441]:         </nova:port>
Aug 09 19:27:37 user nova-compute[72441]:       </nova:ports>
Aug 09 19:27:37 user nova-compute[72441]:     </nova:instance>
Aug 09 19:27:37 user nova-compute[72441]:   </metadata>
Aug 09 19:27:37 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:27:37 user nova-compute[72441]:     <system>
Aug 09 19:27:37 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:27:37 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:27:37 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:27:37 user nova-compute[72441]:       <entry name="serial">e30cf305-f264-4aab-a4cf-f555a57e8db3</entry>
Aug 09 19:27:37 user nova-compute[72441]:       <entry name="uuid">e30cf305-f264-4aab-a4cf-f555a57e8db3</entry>
Aug 09 19:27:37 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:27:37 user nova-compute[72441]:     </system>
Aug 09 19:27:37 user nova-compute[72441]:   </sysinfo>
Aug 09 19:27:37 user nova-compute[72441]:   <os>
Aug 09 19:27:37 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:27:37 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:27:37 user nova-compute[72441]:   </os>
Aug 09 19:27:37 user nova-compute[72441]:   <features>
Aug 09 19:27:37 user nova-compute[72441]:     <acpi/>
Aug 09 19:27:37 user nova-compute[72441]:     <apic/>
Aug 09 19:27:37 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:27:37 user nova-compute[72441]:   </features>
Aug 09 19:27:37 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:27:37 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:27:37 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:27:37 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:27:37 user nova-compute[72441]:   </clock>
Aug 09 19:27:37 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:27:37 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:27:37 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:27:37 user nova-compute[72441]:   </cpu>
Aug 09 19:27:37 user nova-compute[72441]:   <devices>
Aug 09 19:27:37 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:27:37 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:27:37 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue"/>
Aug 09 19:27:37 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:27:37 user nova-compute[72441]:     </disk>
Aug 09 19:27:37 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:27:37 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:27:37 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk"/>
Aug 09 19:27:37 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:27:37 user nova-compute[72441]:     </disk>
Aug 09 19:27:37 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:27:37 user nova-compute[72441]:       <mac address="fa:16:3e:e7:08:91"/>
Aug 09 19:27:37 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:27:37 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:27:37 user nova-compute[72441]:       <target dev="tap9c11f350-19"/>
Aug 09 19:27:37 user nova-compute[72441]:     </interface>
Aug 09 19:27:37 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:27:37 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/console.log" append="off"/>
Aug 09 19:27:37 user nova-compute[72441]:     </serial>
Aug 09 19:27:37 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:27:37 user nova-compute[72441]:     <video>
Aug 09 19:27:37 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:27:37 user nova-compute[72441]:     </video>
Aug 09 19:27:37 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:27:37 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:27:37 user nova-compute[72441]:     </rng>
Aug 09 19:27:37 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:27:37 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:27:37 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:27:37 user nova-compute[72441]:     </memballoon>
Aug 09 19:27:37 user nova-compute[72441]:   </devices>
Aug 09 19:27:37 user nova-compute[72441]: </domain>
Aug 09 19:27:37 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:27:37 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance destroyed successfully.
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:e7:08:91, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 2ee4681e-d00f-47af-8b44-e4f8986b60ea due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609258.747251, 2ee4681e-d00f-47af-8b44-e4f8986b60ea => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:38 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] VM Resumed (Lifecycle Event)
Aug 09 19:27:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance running successfully.
Aug 09 19:27:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance soft rebooted successfully.
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:27:38 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609258.7515514, 2ee4681e-d00f-47af-8b44-e4f8986b60ea => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:38 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] VM Started (Lifecycle Event)
Aug 09 19:27:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-61d254d2-1f84-43db-bb01-ef8343e37bda tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.936s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:27:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:39 user nova-compute[72441]: WARNING nova.compute.manager [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state resized and task_state resize_reverting.
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:39 user nova-compute[72441]: WARNING nova.compute.manager [req-e2637190-d837-4e26-9d1f-9e498015e1dd req-e231d878-a8e8-4b49-a01e-bce511fb6833 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state resized and task_state resize_reverting.
Aug 09 19:27:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609259.457628, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Resumed (Lifecycle Event)
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:27:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance running successfully.
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] finish_revert_migration finished successfully. {{(pid=72441) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:27:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609259.4668567, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Started (Lifecycle Event)
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:27:39 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 19:27:39 user nova-compute[72441]: INFO nova.compute.manager [None req-c621f74b-b73f-460e-9e25-cdcfe1838843 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance to original state: 'active'
Aug 09 19:27:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:41 user nova-compute[72441]: WARNING nova.compute.manager [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state active and task_state rescuing.
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:27:41 user nova-compute[72441]: WARNING nova.compute.manager [req-19986a37-00df-4ff3-898c-275f0bfb0430 req-c329e4a9-99e4-452b-8e7a-3bf257f2675e service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state active and task_state rescuing.
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for e30cf305-f264-4aab-a4cf-f555a57e8db3 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609261.7684667, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:41 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Resumed (Lifecycle Event)
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-7862a1f8-7c37-4d3e-ab6f-1f27f025dacd tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:27:41 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609261.772175, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:27:41 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Started (Lifecycle Event)
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:27:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-changed-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Refreshing instance network info cache due to event network-changed-afd05d43-10df-4d08-bdd6-e5994b7b8aa0. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] Acquiring lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] Acquired lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG nova.network.neutron [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Refreshing network info cache for port afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'flavor' on Instance uuid 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG nova.network.neutron [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updated VIF entry in instance network info cache for port afd05d43-10df-4d08-bdd6-e5994b7b8aa0. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG nova.network.neutron [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updating instance_info_cache with network_info: [{"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6df21be1-6555-44aa-a057-94c0f2eff8d7 req-ee10825d-2c9c-45bd-8bcb-e2fd2226d3ed service nova] Releasing lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:27:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:27:49 user nova-compute[72441]: INFO nova.compute.manager [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Attaching volume 903362c8-6fe2-4806-ba0d-c0bca173ec00 to /dev/vdb
Aug 09 19:27:50 user nova-compute[72441]: DEBUG os_brick.utils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[073f131f-5d59-44b2-af7c-fce9eb08cee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de095fef-c396-4a63-bdaf-4b1443e979c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58213f54-cec0-4e6f-9afa-3e34e4098c9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf18c66-211a-4ce5-a0a5-066c940f8e73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:27:50 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fffa9c-6017-4c5f-a150-8a8b454c7d6e]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG os_brick.utils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updating existing volume attachment record: ff5305d2-fe19-4b97-bb5f-a9404bae4753 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:27:50 user nova-compute[72441]: INFO nova.compute.manager [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] instance snapshotting
Aug 09 19:27:50 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Beginning live snapshot process
Aug 09 19:27:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.187s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1bj_b8wu/302d9509984547348a901f34710c9772.delta 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1bj_b8wu/302d9509984547348a901f34710c9772.delta 1073741824" returned: 0 in 0.088s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 19:27:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:27:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:27:52 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 19:27:53 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:27:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1bj_b8wu/302d9509984547348a901f34710c9772.delta /opt/stack/data/nova/instances/snapshots/tmp1bj_b8wu/302d9509984547348a901f34710c9772 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1bj_b8wu/302d9509984547348a901f34710c9772.delta /opt/stack/data/nova/instances/snapshots/tmp1bj_b8wu/302d9509984547348a901f34710c9772" returned: 0 in 0.579s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Snapshot extracted, beginning image upload
Aug 09 19:27:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:56 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Snapshot image upload complete
Aug 09 19:27:56 user nova-compute[72441]: INFO nova.compute.manager [None req-22a39515-5753-41b0-9296-fe2dacdebc51 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Took 5.83 seconds to snapshot the instance on the hypervisor.
Aug 09 19:27:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiklPAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:27:59 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:59 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:27:59 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5f720-80b6-408b-a92e-30c85ae4a973]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:27:59 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae89a570-9e5f-4ac6-b07a-5204e6dfa5b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00] added
Aug 09 19:27:59 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:27:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c271cd-2743-4116-bfd7-a4b60a80850c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1480d2-765c-4094-afb2-021ae5398c92]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foiklPAC {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foiklPAC" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa3d00-5c5f-48df-bbd2-be46fbf6dc6a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'foiklPAC'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20c6a09-1a2f-4e72-9509-5c4d036cadd7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cbe9b0-86e8-4ba8-91f1-24908c6364bb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[949755b3-4d94-4000-8d21-e0229a563b79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260]
Aug 09 19:28:00 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260] successful.
Aug 09 19:28:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5551333-c5e2-42f3-ab76-e3a5beb98782]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab941aff-60c0-42a7-9e85-d4762129d1b5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 (non-flash)
Aug 09 19:28:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3458824c-2a02-413a-91e6-da470243aeb6]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:28:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiklPAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23035363130373437', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035363130373437', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'flavor' on Instance uuid 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:28:01 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:28:01 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:28:01 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:28:01 user nova-compute[72441]:   <serial>903362c8-6fe2-4806-ba0d-c0bca173ec00</serial>
Aug 09 19:28:01 user nova-compute[72441]: </disk>
Aug 09 19:28:01 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No VIF found with MAC fa:16:3e:7e:c0:e1, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:28:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7f6d7e90-7876-4d1c-93f4-e6b6585a9be7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.965s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:04 user nova-compute[72441]: INFO nova.compute.manager [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Detaching volume 903362c8-6fe2-4806-ba0d-c0bca173ec00
Aug 09 19:28:04 user nova-compute[72441]: INFO nova.virt.block_device [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Attempting to driver detach volume 903362c8-6fe2-4806-ba0d-c0bca173ec00 from mountpoint /dev/vdb
Aug 09 19:28:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Attempting to detach device vdb from instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:28:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:28:04 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:28:04 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:28:04 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:28:04 user nova-compute[72441]:   <serial>903362c8-6fe2-4806-ba0d-c0bca173ec00</serial>
Aug 09 19:28:04 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:28:04 user nova-compute[72441]: </disk>
Aug 09 19:28:04 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:28:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully detached device vdb from instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d from the persistent domain config.
Aug 09 19:28:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:28:05 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:28:05 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:28:05 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:28:05 user nova-compute[72441]:   <serial>903362c8-6fe2-4806-ba0d-c0bca173ec00</serial>
Aug 09 19:28:05 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:28:05 user nova-compute[72441]: </disk>
Aug 09 19:28:05 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609285.4619615, 6294a114-45f2-45f4-bfd3-a99fd3c7b61d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:28:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully detached device vdb from instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d from the live domain config.
Aug 09 19:28:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foiklPAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:28:05 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec55588-f53d-459a-ae27-8cd50f2049c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3a49ba-cbba-42a4-9383-dfe4177daa79]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 (non-flash)
Aug 09 19:28:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90593490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6fb5a2-187a-4270-857f-a026be1a4e1e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dbf271-4a34-4b8d-b14a-2b607ed4f6ce]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b89117d-57cb-448e-8498-c7bcd4c84ffa]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5da0ac-fe37-4139-986f-55f6cb7ff04c]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315002e-18b8-4a4e-9d98-16c559cae3d8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fdfe78-6c6f-419d-8420-edabb3057dd0]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260]
Aug 09 19:28:05 user nova-compute[72441]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00, portal: 172.16.0.220,3260] successful.
Aug 09 19:28:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:903362c8-6fe2-4806-ba0d-c0bca173ec00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[632958a0-575f-4355-bcd5-92bb7e00a91e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] <== disconnect_volume: return (357ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:28:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:28:06 user nova-compute[72441]: INFO nova.compute.claims [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Claim successful on node user
Aug 09 19:28:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'flavor' on Instance uuid 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ff27b22f-8d33-42da-808e-e0d89cc9deee tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.832s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.975s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:28:07 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.policy [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30843aacab5b4db3b76b43cf978bc721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae6d33400f3444387a69b9fc79e4b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:28:07 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Creating image(s)
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "/opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk 1073741824" returned: 0 in 0.054s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Cannot resize image /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'migration_context' on Instance uuid 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Ensure instance console log exists: /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Successfully created port: 2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Successfully updated port: 2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquired lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:28:09 user nova-compute[72441]: INFO nova.compute.claims [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Claim successful on node user
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-changed-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Refreshing instance network info cache due to event network-changed-2f79ca90-0705-4b5f-a9e1-39b74bc865f1. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] Acquiring lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:09 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updating instance_info_cache with network_info: [{"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Releasing lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Instance network_info: |[{"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] Acquired lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Refreshing network info cache for port 2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Start _get_guest_xml network_info=[{"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:28:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-488126171',display_name='tempest-AttachVolumeNegativeTest-server-488126171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-488126171',id=30,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6cRALvVztVtI+jowNzS4IPxjaHM4iYSH7955OZ+XbnQhOfLFXZi1BBQV84le32EZCUfr4FBZt1sOytERj9rThNYzJ5sd2AWzf/SE3FKXFuh/mGh4GSRBwWGMxu0OQOjA==',key_name='tempest-keypair-749717868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-3v1zlway',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:28:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=2b3a4c39-be92-42c6-86ec-8fcb5447b577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:28:10 user nova-compute[72441]:   <uuid>2b3a4c39-be92-42c6-86ec-8fcb5447b577</uuid>
Aug 09 19:28:10 user nova-compute[72441]:   <name>instance-0000001e</name>
Aug 09 19:28:10 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:28:10 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:28:10 user nova-compute[72441]:   <metadata>
Aug 09 19:28:10 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:28:10 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:28:10 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-488126171</nova:name>
Aug 09 19:28:10 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:28:10</nova:creationTime>
Aug 09 19:28:10 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:28:10 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:28:10 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:28:10 user nova-compute[72441]:       <nova:owner>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:user uuid="30843aacab5b4db3b76b43cf978bc721">tempest-AttachVolumeNegativeTest-2037425419-project-member</nova:user>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:project uuid="8ae6d33400f3444387a69b9fc79e4b75">tempest-AttachVolumeNegativeTest-2037425419</nova:project>
Aug 09 19:28:10 user nova-compute[72441]:       </nova:owner>
Aug 09 19:28:10 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:28:10 user nova-compute[72441]:       <nova:ports>
Aug 09 19:28:10 user nova-compute[72441]:         <nova:port uuid="2f79ca90-0705-4b5f-a9e1-39b74bc865f1">
Aug 09 19:28:10 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:28:10 user nova-compute[72441]:         </nova:port>
Aug 09 19:28:10 user nova-compute[72441]:       </nova:ports>
Aug 09 19:28:10 user nova-compute[72441]:     </nova:instance>
Aug 09 19:28:10 user nova-compute[72441]:   </metadata>
Aug 09 19:28:10 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:28:10 user nova-compute[72441]:     <system>
Aug 09 19:28:10 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:28:10 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:28:10 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:28:10 user nova-compute[72441]:       <entry name="serial">2b3a4c39-be92-42c6-86ec-8fcb5447b577</entry>
Aug 09 19:28:10 user nova-compute[72441]:       <entry name="uuid">2b3a4c39-be92-42c6-86ec-8fcb5447b577</entry>
Aug 09 19:28:10 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:28:10 user nova-compute[72441]:     </system>
Aug 09 19:28:10 user nova-compute[72441]:   </sysinfo>
Aug 09 19:28:10 user nova-compute[72441]:   <os>
Aug 09 19:28:10 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:28:10 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:28:10 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:28:10 user nova-compute[72441]:   </os>
Aug 09 19:28:10 user nova-compute[72441]:   <features>
Aug 09 19:28:10 user nova-compute[72441]:     <acpi/>
Aug 09 19:28:10 user nova-compute[72441]:     <apic/>
Aug 09 19:28:10 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:28:10 user nova-compute[72441]:   </features>
Aug 09 19:28:10 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:28:10 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:28:10 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:28:10 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:28:10 user nova-compute[72441]:   </clock>
Aug 09 19:28:10 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:28:10 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:28:10 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:28:10 user nova-compute[72441]:   </cpu>
Aug 09 19:28:10 user nova-compute[72441]:   <devices>
Aug 09 19:28:10 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:28:10 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:28:10 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk"/>
Aug 09 19:28:10 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:28:10 user nova-compute[72441]:     </disk>
Aug 09 19:28:10 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:28:10 user nova-compute[72441]:       <mac address="fa:16:3e:fa:fc:e4"/>
Aug 09 19:28:10 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:28:10 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:28:10 user nova-compute[72441]:       <target dev="tap2f79ca90-07"/>
Aug 09 19:28:10 user nova-compute[72441]:     </interface>
Aug 09 19:28:10 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:28:10 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/console.log" append="off"/>
Aug 09 19:28:10 user nova-compute[72441]:     </serial>
Aug 09 19:28:10 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:28:10 user nova-compute[72441]:     <video>
Aug 09 19:28:10 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:28:10 user nova-compute[72441]:     </video>
Aug 09 19:28:10 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:28:10 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:28:10 user nova-compute[72441]:     </rng>
Aug 09 19:28:10 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:28:10 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:28:10 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:28:10 user nova-compute[72441]:     </memballoon>
Aug 09 19:28:10 user nova-compute[72441]:   </devices>
Aug 09 19:28:10 user nova-compute[72441]: </domain>
Aug 09 19:28:10 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-488126171',display_name='tempest-AttachVolumeNegativeTest-server-488126171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-488126171',id=30,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6cRALvVztVtI+jowNzS4IPxjaHM4iYSH7955OZ+XbnQhOfLFXZi1BBQV84le32EZCUfr4FBZt1sOytERj9rThNYzJ5sd2AWzf/SE3FKXFuh/mGh4GSRBwWGMxu0OQOjA==',key_name='tempest-keypair-749717868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-3v1zlway',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:28:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=2b3a4c39-be92-42c6-86ec-8fcb5447b577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG os_vif [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f79ca90-07, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f79ca90-07, col_values=(('external_ids', {'iface-id': '2f79ca90-0705-4b5f-a9e1-39b74bc865f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:fc:e4', 'vm-uuid': '2b3a4c39-be92-42c6-86ec-8fcb5447b577'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:10 user nova-compute[72441]: INFO os_vif [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07')
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:fa:fc:e4, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:28:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.policy [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '890855d048044ea89e304b9fc38b7600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8e21260bfe4c228b1f97b1dbb7a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:28:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Creating image(s)
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updated VIF entry in instance network info cache for port 2f79ca90-0705-4b5f-a9e1-39b74bc865f1. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updating instance_info_cache with network_info: [{"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-73a30361-677e-454d-ba0b-fc63b4a6c015 req-d0d7f4bf-911b-4c52-9e11-09c152628377 service nova] Releasing lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk 1073741824" returned: 0 in 0.100s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Cannot resize image /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'migration_context' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Successfully created port: e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Ensure instance console log exists: /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-78576be2-782d-4474-8dbe-6ad99085213c req-ec8dca5f-e9db-43b5-8f63-2ceba2eabd5c service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-78576be2-782d-4474-8dbe-6ad99085213c req-ec8dca5f-e9db-43b5-8f63-2ceba2eabd5c service nova] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-78576be2-782d-4474-8dbe-6ad99085213c req-ec8dca5f-e9db-43b5-8f63-2ceba2eabd5c service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-78576be2-782d-4474-8dbe-6ad99085213c req-ec8dca5f-e9db-43b5-8f63-2ceba2eabd5c service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-78576be2-782d-4474-8dbe-6ad99085213c req-ec8dca5f-e9db-43b5-8f63-2ceba2eabd5c service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] No waiting events found dispatching network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:12 user nova-compute[72441]: WARNING nova.compute.manager [req-78576be2-782d-4474-8dbe-6ad99085213c req-ec8dca5f-e9db-43b5-8f63-2ceba2eabd5c service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received unexpected event network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 for instance with vm_state building and task_state spawning.
Aug 09 19:28:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Successfully updated port: e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:28:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance network_info: |[{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Start _get_guest_xml network_info=[{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:28:13 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:13 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-121406836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-121406836',id=31,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaOjCy7otZPDTbCdIVBaOk1sjHOF0X+g86O3I2SFeW28nsz8beaJ7hQOaJdOgfKXTQiybezEpi3RTHMAohT9IR6pOmSEpJbj25Ui1FOILwGGah+hV5pwYXxHaBdg6ULDQ==',key_name='tempest-keypair-1680402287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-77vjub3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=471adda1-bc0b-42e6-9476-206c9ec9b58f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'pci_devices' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:28:13 user nova-compute[72441]:   <uuid>471adda1-bc0b-42e6-9476-206c9ec9b58f</uuid>
Aug 09 19:28:13 user nova-compute[72441]:   <name>instance-0000001f</name>
Aug 09 19:28:13 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:28:13 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:28:13 user nova-compute[72441]:   <metadata>
Aug 09 19:28:13 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:28:13 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:28:13 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-121406836</nova:name>
Aug 09 19:28:13 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:28:13</nova:creationTime>
Aug 09 19:28:13 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:28:13 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:28:13 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:28:13 user nova-compute[72441]:       <nova:owner>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:user uuid="890855d048044ea89e304b9fc38b7600">tempest-AttachVolumeShelveTestJSON-1792449968-project-member</nova:user>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:project uuid="5f8e21260bfe4c228b1f97b1dbb7a049">tempest-AttachVolumeShelveTestJSON-1792449968</nova:project>
Aug 09 19:28:13 user nova-compute[72441]:       </nova:owner>
Aug 09 19:28:13 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:28:13 user nova-compute[72441]:       <nova:ports>
Aug 09 19:28:13 user nova-compute[72441]:         <nova:port uuid="e3a03733-e309-4dbd-bb21-c902f5136858">
Aug 09 19:28:13 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 19:28:13 user nova-compute[72441]:         </nova:port>
Aug 09 19:28:13 user nova-compute[72441]:       </nova:ports>
Aug 09 19:28:13 user nova-compute[72441]:     </nova:instance>
Aug 09 19:28:13 user nova-compute[72441]:   </metadata>
Aug 09 19:28:13 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:28:13 user nova-compute[72441]:     <system>
Aug 09 19:28:13 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:28:13 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:28:13 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:28:13 user nova-compute[72441]:       <entry name="serial">471adda1-bc0b-42e6-9476-206c9ec9b58f</entry>
Aug 09 19:28:13 user nova-compute[72441]:       <entry name="uuid">471adda1-bc0b-42e6-9476-206c9ec9b58f</entry>
Aug 09 19:28:13 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:28:13 user nova-compute[72441]:     </system>
Aug 09 19:28:13 user nova-compute[72441]:   </sysinfo>
Aug 09 19:28:13 user nova-compute[72441]:   <os>
Aug 09 19:28:13 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:28:13 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:28:13 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:28:13 user nova-compute[72441]:   </os>
Aug 09 19:28:13 user nova-compute[72441]:   <features>
Aug 09 19:28:13 user nova-compute[72441]:     <acpi/>
Aug 09 19:28:13 user nova-compute[72441]:     <apic/>
Aug 09 19:28:13 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:28:13 user nova-compute[72441]:   </features>
Aug 09 19:28:13 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:28:13 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:28:13 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:28:13 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:28:13 user nova-compute[72441]:   </clock>
Aug 09 19:28:13 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:28:13 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:28:13 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:28:13 user nova-compute[72441]:   </cpu>
Aug 09 19:28:13 user nova-compute[72441]:   <devices>
Aug 09 19:28:13 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:28:13 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:28:13 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk"/>
Aug 09 19:28:13 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:28:13 user nova-compute[72441]:     </disk>
Aug 09 19:28:13 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:28:13 user nova-compute[72441]:       <mac address="fa:16:3e:86:76:98"/>
Aug 09 19:28:13 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:28:13 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:28:13 user nova-compute[72441]:       <target dev="tape3a03733-e3"/>
Aug 09 19:28:13 user nova-compute[72441]:     </interface>
Aug 09 19:28:13 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:28:13 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/console.log" append="off"/>
Aug 09 19:28:13 user nova-compute[72441]:     </serial>
Aug 09 19:28:13 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:28:13 user nova-compute[72441]:     <video>
Aug 09 19:28:13 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:28:13 user nova-compute[72441]:     </video>
Aug 09 19:28:13 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:28:13 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:28:13 user nova-compute[72441]:     </rng>
Aug 09 19:28:13 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:28:13 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:28:13 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:28:13 user nova-compute[72441]:     </memballoon>
Aug 09 19:28:13 user nova-compute[72441]:   </devices>
Aug 09 19:28:13 user nova-compute[72441]: </domain>
Aug 09 19:28:13 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-121406836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-121406836',id=31,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaOjCy7otZPDTbCdIVBaOk1sjHOF0X+g86O3I2SFeW28nsz8beaJ7hQOaJdOgfKXTQiybezEpi3RTHMAohT9IR6pOmSEpJbj25Ui1FOILwGGah+hV5pwYXxHaBdg6ULDQ==',key_name='tempest-keypair-1680402287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-77vjub3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=471adda1-bc0b-42e6-9476-206c9ec9b58f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG os_vif [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3a03733-e3, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3a03733-e3, col_values=(('external_ids', {'iface-id': 'e3a03733-e309-4dbd-bb21-c902f5136858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:76:98', 'vm-uuid': '471adda1-bc0b-42e6-9476-206c9ec9b58f'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:13 user nova-compute[72441]: INFO os_vif [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3')
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No VIF found with MAC fa:16:3e:86:76:98, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609293.931796, 2b3a4c39-be92-42c6-86ec-8fcb5447b577 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:13 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] VM Resumed (Lifecycle Event)
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:28:13 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Instance spawned successfully.
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:14 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609293.933742, 2b3a4c39-be92-42c6-86ec-8fcb5447b577 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:14 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] VM Started (Lifecycle Event)
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:14 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:28:14 user nova-compute[72441]: INFO nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] No waiting events found dispatching network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:14 user nova-compute[72441]: WARNING nova.compute.manager [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received unexpected event network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 for instance with vm_state building and task_state spawning.
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing instance network info cache due to event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:28:14 user nova-compute[72441]: INFO nova.compute.manager [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Took 7.71 seconds to build instance.
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b6330d8e-2d75-4bf6-b38e-7afbc2b711b6 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.819s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updated VIF entry in instance network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-516ac696-14c4-4278-81ab-fa5311598f4c req-64d41d5d-6706-436b-ae7a-b3bb5de524ba service nova] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-66b0b353-e560-4473-972d-b8bd9a459d60 req-88146388-d507-47a1-a207-1e720b3652a2 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-66b0b353-e560-4473-972d-b8bd9a459d60 req-88146388-d507-47a1-a207-1e720b3652a2 service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-66b0b353-e560-4473-972d-b8bd9a459d60 req-88146388-d507-47a1-a207-1e720b3652a2 service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-66b0b353-e560-4473-972d-b8bd9a459d60 req-88146388-d507-47a1-a207-1e720b3652a2 service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-66b0b353-e560-4473-972d-b8bd9a459d60 req-88146388-d507-47a1-a207-1e720b3652a2 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:14 user nova-compute[72441]: WARNING nova.compute.manager [req-66b0b353-e560-4473-972d-b8bd9a459d60 req-88146388-d507-47a1-a207-1e720b3652a2 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state building and task_state spawning.
Aug 09 19:28:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-5130c0ca-eb22-4d18-940d-638d3c27d368 req-591d74cd-4d92-4906-bf27-7a0775141d9b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5130c0ca-eb22-4d18-940d-638d3c27d368 req-591d74cd-4d92-4906-bf27-7a0775141d9b service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5130c0ca-eb22-4d18-940d-638d3c27d368 req-591d74cd-4d92-4906-bf27-7a0775141d9b service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5130c0ca-eb22-4d18-940d-638d3c27d368 req-591d74cd-4d92-4906-bf27-7a0775141d9b service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-5130c0ca-eb22-4d18-940d-638d3c27d368 req-591d74cd-4d92-4906-bf27-7a0775141d9b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:16 user nova-compute[72441]: WARNING nova.compute.manager [req-5130c0ca-eb22-4d18-940d-638d3c27d368 req-591d74cd-4d92-4906-bf27-7a0775141d9b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state building and task_state spawning.
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609297.1198323, 471adda1-bc0b-42e6-9476-206c9ec9b58f => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] VM Resumed (Lifecycle Event)
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance spawned successfully.
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609297.1234512, 471adda1-bc0b-42e6-9476-206c9ec9b58f => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] VM Started (Lifecycle Event)
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 09 19:28:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:17 user nova-compute[72441]: INFO nova.compute.manager [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Took 7.85 seconds to build instance.
Aug 09 19:28:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f876daba-40a5-46b7-8bbf-2c8042c29e72 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.966s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-changed-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Refreshing instance network info cache due to event network-changed-aae0b6a1-4106-4bbe-b283-e728f6dca34e. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:28:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:20 user nova-compute[72441]: DEBUG nova.network.neutron [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Refreshing network info cache for port aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:28:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updated VIF entry in instance network info cache for port aae0b6a1-4106-4bbe-b283-e728f6dca34e. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4afdabb6-0671-4f74-b681-e28db004a0d3 req-3abd695a-ba1c-45ee-9cde-a1cde29dde0f service nova] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-changed-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Refreshing instance network info cache due to event network-changed-90f08f9d-d5d3-474a-a749-1333262e0c9c. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] Acquiring lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] Acquired lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Refreshing network info cache for port 90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updated VIF entry in instance network info cache for port 90f08f9d-d5d3-474a-a749-1333262e0c9c. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a75b1740-69d7-45e1-ab0f-a4d6b4efc4be req-03ce042a-9a3a-4d8b-897f-040cf8839c58 service nova] Releasing lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Stashing vm_state: active {{(pid=72441) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'pci_requests' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:28:23 user nova-compute[72441]: INFO nova.compute.claims [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Claim successful on node user
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'resources' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'pci_devices' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:23 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating resource usage from migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe
Aug 09 19:28:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:28:24 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:28:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.883s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:24 user nova-compute[72441]: INFO nova.compute.manager [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Migrating
Aug 09 19:28:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquired lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:28:24 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Releasing lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:25 user nova-compute[72441]: INFO nova.compute.manager [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Terminating instance
Aug 09 19:28:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Starting migrate_disk_and_power_off {{(pid=72441) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-c62a14ca-d601-4c76-b654-df9164e5afa7 req-d037ddb7-a01a-4d53-bbd9-a539bdb2cc47 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-unplugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c62a14ca-d601-4c76-b654-df9164e5afa7 req-d037ddb7-a01a-4d53-bbd9-a539bdb2cc47 service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c62a14ca-d601-4c76-b654-df9164e5afa7 req-d037ddb7-a01a-4d53-bbd9-a539bdb2cc47 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c62a14ca-d601-4c76-b654-df9164e5afa7 req-d037ddb7-a01a-4d53-bbd9-a539bdb2cc47 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-c62a14ca-d601-4c76-b654-df9164e5afa7 req-d037ddb7-a01a-4d53-bbd9-a539bdb2cc47 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-unplugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:26 user nova-compute[72441]: WARNING nova.compute.manager [req-c62a14ca-d601-4c76-b654-df9164e5afa7 req-d037ddb7-a01a-4d53-bbd9-a539bdb2cc47 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-unplugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state active and task_state resize_migrating.
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-233beed4-1e90-474d-a5c5-3ccf1b643424 req-3352b714-dd4c-498f-ac10-991f9b9f7a46 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-unplugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-233beed4-1e90-474d-a5c5-3ccf1b643424 req-3352b714-dd4c-498f-ac10-991f9b9f7a46 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-233beed4-1e90-474d-a5c5-3ccf1b643424 req-3352b714-dd4c-498f-ac10-991f9b9f7a46 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-233beed4-1e90-474d-a5c5-3ccf1b643424 req-3352b714-dd4c-498f-ac10-991f9b9f7a46 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-233beed4-1e90-474d-a5c5-3ccf1b643424 req-3352b714-dd4c-498f-ac10-991f9b9f7a46 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-unplugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-233beed4-1e90-474d-a5c5-3ccf1b643424 req-3352b714-dd4c-498f-ac10-991f9b9f7a46 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-unplugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance destroyed successfully.
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1170996063',display_name='tempest-ServerActionsTestOtherA-server-1170996063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1170996063',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:26:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1pusvuyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=bb15c890-ce98-4e03-811f-8459d12120f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90f08f9d-d5, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Instance destroyed successfully.
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lazy-loading 'resources' on Instance uuid f0c45570-1b41-4666-9fe0-ed489926132b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: INFO os_vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5')
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:28:26 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T19:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1418015898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1418015898',id=25,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYQIF2Rk7rOeuQu0bCMZG+qcVm40Eg4GQ0fvqhSj+rpovHOwcV+CBdHCcWz2ByqZxdtNqS5g4jqcEdRXHFfyaOGmLrNzKNBSHOdmqiD9ZhdwkqTnSoK2b84pIcUytcskA==',key_name='tempest-keypair-816584140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57335007b06a45ad9f91aa03555d5428',ramdisk_id='',reservation_id='r-n0nt6ni2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1198161654',owner_user_name='tempest-TaggedAttachmentsTest-1198161654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f208845e39d41c5b4a2b76748c8e658',uuid=f0c45570-1b41-4666-9fe0-ed489926132b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converting VIF {"id": "f88a4415-bd67-4929-be84-66c1fdee068e", "address": "fa:16:3e:d4:a5:a9", "network": {"id": "0fcbbce3-2762-4cfe-8ec7-17658442b8ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-495356340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57335007b06a45ad9f91aa03555d5428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88a4415-bd", "ovs_interfaceid": "f88a4415-bd67-4929-be84-66c1fdee068e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_vif [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf88a4415-bd, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:28:26 user nova-compute[72441]: INFO os_vif [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:a5:a9,bridge_name='br-int',has_traffic_filtering=True,id=f88a4415-bd67-4929-be84-66c1fdee068e,network=Network(0fcbbce3-2762-4cfe-8ec7-17658442b8ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88a4415-bd')
Aug 09 19:28:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Deleting instance files /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b_del
Aug 09 19:28:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Deletion of /opt/stack/data/nova/instances/f0c45570-1b41-4666-9fe0-ed489926132b_del complete
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839bda3-2429-4e45-90b4-dced59aac97f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0f1fa67-2cb1-461e-a7a6-2a1d3f425d57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab432a-de16-40bb-a64e-2ce2fd62ca67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f1fa67-2cb1-461e-a7a6-2a1d3f425d57 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f1fa67-2cb1-461e-a7a6-2a1d3f425d57 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:28:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f1fa67-2cb1-461e-a7a6-2a1d3f425d57 (non-flash)
Aug 09 19:28:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90593f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d78194-c69c-41ae-ace4-486d3d07d690]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:27 user nova-compute[72441]: INFO nova.compute.manager [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.049s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6d140-2a18-4c4a-8e81-d9e5ec568b6a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.038s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdb9664-373b-447c-a77e-b6f0fd549e5c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.128s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb074e0-7297-4351-a51b-06d9580c6a53]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37626c5-5145-4f4b-9fcf-930df8877c07]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.148s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3946ddbf-3cfe-4252-83b7-f21dc29ec2d3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]
Aug 09 19:28:27 user nova-compute[72441]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.
Aug 09 19:28:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.085s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1438e9d3-d568-49c8-a4e2-5c5a6debfad4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.712s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== disconnect_volume: return (715ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-b9ed2f3b-608a-402b-8447-808039618440 req-49acbc19-318e-445f-84bf-64c61bb78068 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b9ed2f3b-608a-402b-8447-808039618440 req-49acbc19-318e-445f-84bf-64c61bb78068 service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b9ed2f3b-608a-402b-8447-808039618440 req-49acbc19-318e-445f-84bf-64c61bb78068 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b9ed2f3b-608a-402b-8447-808039618440 req-49acbc19-318e-445f-84bf-64c61bb78068 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-b9ed2f3b-608a-402b-8447-808039618440 req-49acbc19-318e-445f-84bf-64c61bb78068 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:28 user nova-compute[72441]: WARNING nova.compute.manager [req-b9ed2f3b-608a-402b-8447-808039618440 req-49acbc19-318e-445f-84bf-64c61bb78068 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state active and task_state resize_migrating.
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:28 user nova-compute[72441]: WARNING nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state active and task_state deleting.
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:28 user nova-compute[72441]: WARNING nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state active and task_state deleting.
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:28 user nova-compute[72441]: WARNING nova.compute.manager [req-e7fb1171-572b-49dd-b9a0-853ac3e6190b req-7576eafe-e077-42aa-bf2f-60b917f9aff7 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state active and task_state deleting.
Aug 09 19:28:28 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:29 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Took 1.92 seconds to deallocate network for instance.
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Port 90f08f9d-d5d3-474a-a749-1333262e0c9c binding to destination host user is already ACTIVE {{(pid=72441) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquired lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:28:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.704s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:30 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Deleted allocations for instance f0c45570-1b41-4666-9fe0-ed489926132b
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-unplugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-unplugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:30 user nova-compute[72441]: WARNING nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-unplugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state deleted and task_state None.
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-deleted-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] Acquiring lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] Lock "f0c45570-1b41-4666-9fe0-ed489926132b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] No waiting events found dispatching network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:30 user nova-compute[72441]: WARNING nova.compute.manager [req-90fe4ace-9bf2-4aee-a6e1-a15e1a10d94a req-7d4e6b3a-06d4-45f6-b089-009eee88e939 service nova] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Received unexpected event network-vif-plugged-f88a4415-bd67-4929-be84-66c1fdee068e for instance with vm_state deleted and task_state None.
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:28:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Releasing lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-479220ce-1eca-41ce-8280-f797f2efec23 tempest-TaggedAttachmentsTest-1198161654 tempest-TaggedAttachmentsTest-1198161654-project-member] Lock "f0c45570-1b41-4666-9fe0-ed489926132b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.516s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG os_brick.utils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e0d1b7-9a28-4893-9afb-b33c7d3e22ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.058s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db011b-e669-4c06-887c-9a63313f9c4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c4b723-8d3f-4e77-b569-11732ea2e6e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[14404f9d-0e93-425d-8fcb-974aefab25c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:28:31 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad340e1f-e2b9-4e10-8c0b-98718fcac206]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG os_brick.utils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:35 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:35 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6964MB free_disk=24.460521697998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Applying migration context for instance bb15c890-ce98-4e03-811f-8459d12120f8 as it has an incoming, in-progress migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe. Migration status is post-migrating {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 19:28:36 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating resource usage from migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe
Aug 09 19:28:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 471adda1-bc0b-42e6-9476-206c9ec9b58f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Starting finish_migration {{(pid=72441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:28:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Creating image(s)
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Ensure instance console log exists: /opt/stack/data/nova/instances/bb15c890-ce98-4e03-811f-8459d12120f8/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Start _get_guest_xml network_info=[{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bb15c890-ce98-4e03-811f-8459d12120f8', 'attached_at': '2023-08-09T19:28:41.000000', 'detached_at': '', 'volume_id': 'c9659761-2eaf-4e18-b58d-d8cea9cc6dd3', 'serial': 'c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'}, 'attachment_id': '596f17b2-63eb-4acb-ab97-1319a86e14c1', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:28:41 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:41 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:28:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:28:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:28:41 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7cd591-d44e-4324-a75f-f207add1493b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:28:41 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898cb60-bd84-4236-8fa7-d59c6f63744c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3] added
Aug 09 19:28:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b211cd-fbc1-435a-8920-099bcfee20a7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df752851-955e-437f-ae77-68cc598b23a2]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWKnCSgY {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kWKnCSgY" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e0a89-05ba-43a9-a6ca-a1f02f26b292]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kWKnCSgY'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa47780-11c8-46b4-b45a-476e66427ab0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed2faf-ff08-4736-89f8-63e0ad54add8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3791228b-8948-4f23-a3c5-e02557c9cc01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]
Aug 09 19:28:41 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.
Aug 09 19:28:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61b85e-9703-46db-b4b0-094df5ed48df]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ff453-4a1a-4e89-a559-5f16cfab4a1e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:28:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c139aca-643c-499a-9054-cb9851f6096d]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609306.7928731, bb15c890-ce98-4e03-811f-8459d12120f8 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:41 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] VM Stopped (Lifecycle Event)
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8dbd6fd1-000f-4f45-9aba-e4ab9455cfc7 None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609306.8328288, f0c45570-1b41-4666-9fe0-ed489926132b => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:41 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] VM Stopped (Lifecycle Event)
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8dbd6fd1-000f-4f45-9aba-e4ab9455cfc7 None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0dbf85a6-c34d-4f6f-81d5-61a5085932c2 None None] [instance: f0c45570-1b41-4666-9fe0-ed489926132b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:41 user nova-compute[72441]: INFO nova.compute.manager [None req-8dbd6fd1-000f-4f45-9aba-e4ab9455cfc7 None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 19:28:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23561656463356530', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561656463356530', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1170996063',display_name='tempest-ServerActionsTestOtherA-server-1170996063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1170996063',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:26:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1pusvuyj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=bb15c890-ce98-4e03-811f-8459d12120f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:28:42 user nova-compute[72441]:   <uuid>bb15c890-ce98-4e03-811f-8459d12120f8</uuid>
Aug 09 19:28:42 user nova-compute[72441]:   <name>instance-0000001d</name>
Aug 09 19:28:42 user nova-compute[72441]:   <memory>2097152</memory>
Aug 09 19:28:42 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:28:42 user nova-compute[72441]:   <metadata>
Aug 09 19:28:42 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:28:42 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:28:42 user nova-compute[72441]:       <nova:name>tempest-ServerActionsTestOtherA-server-1170996063</nova:name>
Aug 09 19:28:42 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:28:41</nova:creationTime>
Aug 09 19:28:42 user nova-compute[72441]:       <nova:flavor name="m1.small">
Aug 09 19:28:42 user nova-compute[72441]:         <nova:memory>2048</nova:memory>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:disk>20</nova:disk>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:28:42 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:28:42 user nova-compute[72441]:       <nova:owner>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:user uuid="b6d604b2b0d64d9285df9088ee2e8c80">tempest-ServerActionsTestOtherA-683008927-project-member</nova:user>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:project uuid="4775870464a74454992c156806470beb">tempest-ServerActionsTestOtherA-683008927</nova:project>
Aug 09 19:28:42 user nova-compute[72441]:       </nova:owner>
Aug 09 19:28:42 user nova-compute[72441]:       <nova:ports>
Aug 09 19:28:42 user nova-compute[72441]:         <nova:port uuid="90f08f9d-d5d3-474a-a749-1333262e0c9c">
Aug 09 19:28:42 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:28:42 user nova-compute[72441]:         </nova:port>
Aug 09 19:28:42 user nova-compute[72441]:       </nova:ports>
Aug 09 19:28:42 user nova-compute[72441]:     </nova:instance>
Aug 09 19:28:42 user nova-compute[72441]:   </metadata>
Aug 09 19:28:42 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:28:42 user nova-compute[72441]:     <system>
Aug 09 19:28:42 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:28:42 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:28:42 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:28:42 user nova-compute[72441]:       <entry name="serial">bb15c890-ce98-4e03-811f-8459d12120f8</entry>
Aug 09 19:28:42 user nova-compute[72441]:       <entry name="uuid">bb15c890-ce98-4e03-811f-8459d12120f8</entry>
Aug 09 19:28:42 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:28:42 user nova-compute[72441]:     </system>
Aug 09 19:28:42 user nova-compute[72441]:   </sysinfo>
Aug 09 19:28:42 user nova-compute[72441]:   <os>
Aug 09 19:28:42 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:28:42 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:28:42 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:28:42 user nova-compute[72441]:   </os>
Aug 09 19:28:42 user nova-compute[72441]:   <features>
Aug 09 19:28:42 user nova-compute[72441]:     <acpi/>
Aug 09 19:28:42 user nova-compute[72441]:     <apic/>
Aug 09 19:28:42 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:28:42 user nova-compute[72441]:   </features>
Aug 09 19:28:42 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:28:42 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:28:42 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:28:42 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:28:42 user nova-compute[72441]:   </clock>
Aug 09 19:28:42 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:28:42 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:28:42 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:28:42 user nova-compute[72441]:   </cpu>
Aug 09 19:28:42 user nova-compute[72441]:   <devices>
Aug 09 19:28:42 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:28:42 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:28:42 user nova-compute[72441]:       <source dev="/dev/sdc"/>
Aug 09 19:28:42 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:28:42 user nova-compute[72441]:       <serial>c9659761-2eaf-4e18-b58d-d8cea9cc6dd3</serial>
Aug 09 19:28:42 user nova-compute[72441]:     </disk>
Aug 09 19:28:42 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:28:42 user nova-compute[72441]:       <mac address="fa:16:3e:97:5e:be"/>
Aug 09 19:28:42 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:28:42 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:28:42 user nova-compute[72441]:       <target dev="tap90f08f9d-d5"/>
Aug 09 19:28:42 user nova-compute[72441]:     </interface>
Aug 09 19:28:42 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:28:42 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/bb15c890-ce98-4e03-811f-8459d12120f8/console.log" append="off"/>
Aug 09 19:28:42 user nova-compute[72441]:     </serial>
Aug 09 19:28:42 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:28:42 user nova-compute[72441]:     <video>
Aug 09 19:28:42 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:28:42 user nova-compute[72441]:     </video>
Aug 09 19:28:42 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:28:42 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:28:42 user nova-compute[72441]:     </rng>
Aug 09 19:28:42 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:28:42 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:28:42 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:28:42 user nova-compute[72441]:     </memballoon>
Aug 09 19:28:42 user nova-compute[72441]:   </devices>
Aug 09 19:28:42 user nova-compute[72441]: </domain>
Aug 09 19:28:42 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1170996063',display_name='tempest-ServerActionsTestOtherA-server-1170996063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1170996063',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:26:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1pusvuyj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=bb15c890-ce98-4e03-811f-8459d12120f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394253733-network", "vif_mac": "fa:16:3e:97:5e:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG os_vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90f08f9d-d5, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90f08f9d-d5, col_values=(('external_ids', {'iface-id': '90f08f9d-d5d3-474a-a749-1333262e0c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:5e:be', 'vm-uuid': 'bb15c890-ce98-4e03-811f-8459d12120f8'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:42 user nova-compute[72441]: INFO os_vif [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5')
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:28:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] No VIF found with MAC fa:16:3e:97:5e:be, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:28:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab0984e5-35a6-4b6a-b62e-bcd3a7dd90a5 req-b7bcba1a-6b85-4374-98d0-5da73b6f2019 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab0984e5-35a6-4b6a-b62e-bcd3a7dd90a5 req-b7bcba1a-6b85-4374-98d0-5da73b6f2019 service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab0984e5-35a6-4b6a-b62e-bcd3a7dd90a5 req-b7bcba1a-6b85-4374-98d0-5da73b6f2019 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab0984e5-35a6-4b6a-b62e-bcd3a7dd90a5 req-b7bcba1a-6b85-4374-98d0-5da73b6f2019 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab0984e5-35a6-4b6a-b62e-bcd3a7dd90a5 req-b7bcba1a-6b85-4374-98d0-5da73b6f2019 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:44 user nova-compute[72441]: WARNING nova.compute.manager [req-ab0984e5-35a6-4b6a-b62e-bcd3a7dd90a5 req-b7bcba1a-6b85-4374-98d0-5da73b6f2019 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state active and task_state resize_finish.
Aug 09 19:28:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609326.2602675, bb15c890-ce98-4e03-811f-8459d12120f8 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] VM Resumed (Lifecycle Event)
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:28:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance running successfully.
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Failed to set time: agent not configured {{(pid=72441) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ee3bb514-cbdf-4f35-9f6c-07865cb591f4 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] finish_migration finished successfully. {{(pid=72441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609326.263518, bb15c890-ce98-4e03-811f-8459d12120f8 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:28:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] VM Started (Lifecycle Event)
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb9771bc-8935-4029-9cf9-c475bcc487d3 req-41759c73-08b4-4399-8538-e932e5373ffc service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb9771bc-8935-4029-9cf9-c475bcc487d3 req-41759c73-08b4-4399-8538-e932e5373ffc service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb9771bc-8935-4029-9cf9-c475bcc487d3 req-41759c73-08b4-4399-8538-e932e5373ffc service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb9771bc-8935-4029-9cf9-c475bcc487d3 req-41759c73-08b4-4399-8538-e932e5373ffc service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb9771bc-8935-4029-9cf9-c475bcc487d3 req-41759c73-08b4-4399-8538-e932e5373ffc service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:28:46 user nova-compute[72441]: WARNING nova.compute.manager [req-cb9771bc-8935-4029-9cf9-c475bcc487d3 req-41759c73-08b4-4399-8538-e932e5373ffc service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state active and task_state resize_finish.
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:28:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:28:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 19:28:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:28:59 user nova-compute[72441]: INFO nova.compute.claims [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Claim successful on node user
Aug 09 19:28:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:28:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:29:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:29:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:29:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:29:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:29:00 user nova-compute[72441]: INFO nova.virt.block_device [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Booting with volume-backed-image 8b031dc4-f763-4336-82c2-c504ef7f23a0 at /dev/vda
Aug 09 19:29:00 user nova-compute[72441]: DEBUG nova.policy [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '554ea2267ce94d618fbd7ef211cb7b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d7a9e68495428292b9417ee4b234ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:29:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Successfully created port: e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Successfully updated port: e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-changed-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Refreshing instance network info cache due to event network-changed-e1b085d4-02b4-411f-bd06-b5f200ef8540. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] Acquiring lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updating instance_info_cache with network_info: [{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance network_info: |[{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] Acquired lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Refreshing network info cache for port e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updated VIF entry in instance network info cache for port e1b085d4-02b4-411f-bd06-b5f200ef8540. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updating instance_info_cache with network_info: [{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0b9b1fb7-8390-4855-b777-b19d78d03f0e req-671050a1-fcfa-420d-b748-60e494fecd4f service nova] Releasing lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:03 user nova-compute[72441]: INFO nova.compute.manager [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] instance snapshotting
Aug 09 19:29:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Beginning live snapshot process
Aug 09 19:29:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json -f qcow2" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps5sf4374/892a49d833ff45a79688fdc864501dbc.delta 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps5sf4374/892a49d833ff45a79688fdc864501dbc.delta 1073741824" returned: 0 in 0.177s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:04 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 19:29:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:29:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:29:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 19:29:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:06 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:29:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps5sf4374/892a49d833ff45a79688fdc864501dbc.delta /opt/stack/data/nova/instances/snapshots/tmps5sf4374/892a49d833ff45a79688fdc864501dbc {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps5sf4374/892a49d833ff45a79688fdc864501dbc.delta /opt/stack/data/nova/instances/snapshots/tmps5sf4374/892a49d833ff45a79688fdc864501dbc" returned: 0 in 0.530s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Snapshot extracted, beginning image upload
Aug 09 19:29:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:29:08 user nova-compute[72441]: INFO nova.compute.claims [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Claim successful on node user
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:29:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:29:08 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.policy [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd143ff437fe2448f885de68a4e112244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf870ac959134304aacf60967046d8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:29:09 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Creating image(s)
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "/opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "/opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "/opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk 1073741824" returned: 0 in 0.053s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:09 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Snapshot image upload complete
Aug 09 19:29:09 user nova-compute[72441]: INFO nova.compute.manager [None req-31a18f16-bbf7-49b0-a899-870d2ad83d82 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Took 6.01 seconds to snapshot the instance on the hypervisor.
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.161s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Cannot resize image /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.objects.instance [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'migration_context' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Ensure instance console log exists: /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:10 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Successfully created port: fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Successfully updated port: fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquired lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-changed-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Refreshing instance network info cache due to event network-changed-fee49ffd-b7dc-40a3-9898-f8276e90c46f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] Acquiring lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updating instance_info_cache with network_info: [{"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Releasing lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Instance network_info: |[{"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] Acquired lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Refreshing network info cache for port fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Start _get_guest_xml network_info=[{"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:29:11 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:11 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-535432846',display_name='tempest-TestServerVolumeAttachmentScenario-server-535432846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-535432846',id=33,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChWK5A81x7ZnRBlV642Zxuv9qCmWkuMBREw1gEbzRx8fZKgyo8qEoZRzE3A/7Dj8VZPh9zs320M5NsgkEddUmhtLcHD+Ne2RhjxEaYovKMdI56FlMrIgkBWFVd29Ihn0A==',key_name='tempest-keypair-1166871200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf870ac959134304aacf60967046d8c4',ramdisk_id='',reservation_id='r-w5yrwu04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1833202574',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1833202574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d143ff437fe2448f885de68a4e112244',uuid=b16971a4-7b23-4959-a1f4-fa6dd41607b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Converting VIF {"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'pci_devices' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:29:11 user nova-compute[72441]:   <uuid>b16971a4-7b23-4959-a1f4-fa6dd41607b9</uuid>
Aug 09 19:29:11 user nova-compute[72441]:   <name>instance-00000021</name>
Aug 09 19:29:11 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:29:11 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:29:11 user nova-compute[72441]:   <metadata>
Aug 09 19:29:11 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:29:11 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:29:11 user nova-compute[72441]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-535432846</nova:name>
Aug 09 19:29:11 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:29:11</nova:creationTime>
Aug 09 19:29:11 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:29:11 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:29:11 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:29:11 user nova-compute[72441]:       <nova:owner>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:user uuid="d143ff437fe2448f885de68a4e112244">tempest-TestServerVolumeAttachmentScenario-1833202574-project-member</nova:user>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:project uuid="bf870ac959134304aacf60967046d8c4">tempest-TestServerVolumeAttachmentScenario-1833202574</nova:project>
Aug 09 19:29:11 user nova-compute[72441]:       </nova:owner>
Aug 09 19:29:11 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:29:11 user nova-compute[72441]:       <nova:ports>
Aug 09 19:29:11 user nova-compute[72441]:         <nova:port uuid="fee49ffd-b7dc-40a3-9898-f8276e90c46f">
Aug 09 19:29:11 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:29:11 user nova-compute[72441]:         </nova:port>
Aug 09 19:29:11 user nova-compute[72441]:       </nova:ports>
Aug 09 19:29:11 user nova-compute[72441]:     </nova:instance>
Aug 09 19:29:11 user nova-compute[72441]:   </metadata>
Aug 09 19:29:11 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:29:11 user nova-compute[72441]:     <system>
Aug 09 19:29:11 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:29:11 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:29:11 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:29:11 user nova-compute[72441]:       <entry name="serial">b16971a4-7b23-4959-a1f4-fa6dd41607b9</entry>
Aug 09 19:29:11 user nova-compute[72441]:       <entry name="uuid">b16971a4-7b23-4959-a1f4-fa6dd41607b9</entry>
Aug 09 19:29:11 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:29:11 user nova-compute[72441]:     </system>
Aug 09 19:29:11 user nova-compute[72441]:   </sysinfo>
Aug 09 19:29:11 user nova-compute[72441]:   <os>
Aug 09 19:29:11 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:29:11 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:29:11 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:29:11 user nova-compute[72441]:   </os>
Aug 09 19:29:11 user nova-compute[72441]:   <features>
Aug 09 19:29:11 user nova-compute[72441]:     <acpi/>
Aug 09 19:29:11 user nova-compute[72441]:     <apic/>
Aug 09 19:29:11 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:29:11 user nova-compute[72441]:   </features>
Aug 09 19:29:11 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:29:11 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:29:11 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:29:11 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:29:11 user nova-compute[72441]:   </clock>
Aug 09 19:29:11 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:29:11 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:29:11 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:29:11 user nova-compute[72441]:   </cpu>
Aug 09 19:29:11 user nova-compute[72441]:   <devices>
Aug 09 19:29:11 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:29:11 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:29:11 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk"/>
Aug 09 19:29:11 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:29:11 user nova-compute[72441]:     </disk>
Aug 09 19:29:11 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:29:11 user nova-compute[72441]:       <mac address="fa:16:3e:9e:2d:79"/>
Aug 09 19:29:11 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:29:11 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:29:11 user nova-compute[72441]:       <target dev="tapfee49ffd-b7"/>
Aug 09 19:29:11 user nova-compute[72441]:     </interface>
Aug 09 19:29:11 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:29:11 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/console.log" append="off"/>
Aug 09 19:29:11 user nova-compute[72441]:     </serial>
Aug 09 19:29:11 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:29:11 user nova-compute[72441]:     <video>
Aug 09 19:29:11 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:29:11 user nova-compute[72441]:     </video>
Aug 09 19:29:11 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:29:11 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:29:11 user nova-compute[72441]:     </rng>
Aug 09 19:29:11 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:29:11 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:29:11 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:29:11 user nova-compute[72441]:     </memballoon>
Aug 09 19:29:11 user nova-compute[72441]:   </devices>
Aug 09 19:29:11 user nova-compute[72441]: </domain>
Aug 09 19:29:11 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-535432846',display_name='tempest-TestServerVolumeAttachmentScenario-server-535432846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-535432846',id=33,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChWK5A81x7ZnRBlV642Zxuv9qCmWkuMBREw1gEbzRx8fZKgyo8qEoZRzE3A/7Dj8VZPh9zs320M5NsgkEddUmhtLcHD+Ne2RhjxEaYovKMdI56FlMrIgkBWFVd29Ihn0A==',key_name='tempest-keypair-1166871200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf870ac959134304aacf60967046d8c4',ramdisk_id='',reservation_id='r-w5yrwu04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1833202574',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1833202574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d143ff437fe2448f885de68a4e112244',uuid=b16971a4-7b23-4959-a1f4-fa6dd41607b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Converting VIF {"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG os_vif [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfee49ffd-b7, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfee49ffd-b7, col_values=(('external_ids', {'iface-id': 'fee49ffd-b7dc-40a3-9898-f8276e90c46f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:2d:79', 'vm-uuid': 'b16971a4-7b23-4959-a1f4-fa6dd41607b9'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:11 user nova-compute[72441]: INFO os_vif [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7')
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No VIF found with MAC fa:16:3e:9e:2d:79, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:29:11 user nova-compute[72441]: INFO nova.compute.claims [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Claim successful on node user
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updated VIF entry in instance network info cache for port fee49ffd-b7dc-40a3-9898-f8276e90c46f. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updating instance_info_cache with network_info: [{"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de5e5ca8-9ad3-4c2d-b69b-8207ca3e823c req-8f15d8bf-1abb-4c4e-8c77-5727ae2f3195 service nova] Releasing lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:29:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:29:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Creating image(s)
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "/opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "/opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "79c84aea9a735ade76614eebcb753fd962a72ced" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "79c84aea9a735ade76614eebcb753fd962a72ced" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:12 user nova-compute[72441]: DEBUG nova.policy [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a35ddca8c3c14cd0bde36db805885145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95e03143adf4a188effce696ecaf244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Successfully created port: 5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a735d00-b978-4d86-8630-2efc457c49ad req-f8cbc02c-2a89-4d1f-9374-b32ee11d23f7 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a735d00-b978-4d86-8630-2efc457c49ad req-f8cbc02c-2a89-4d1f-9374-b32ee11d23f7 service nova] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a735d00-b978-4d86-8630-2efc457c49ad req-f8cbc02c-2a89-4d1f-9374-b32ee11d23f7 service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a735d00-b978-4d86-8630-2efc457c49ad req-f8cbc02c-2a89-4d1f-9374-b32ee11d23f7 service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a735d00-b978-4d86-8630-2efc457c49ad req-f8cbc02c-2a89-4d1f-9374-b32ee11d23f7 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] No waiting events found dispatching network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:13 user nova-compute[72441]: WARNING nova.compute.manager [req-7a735d00-b978-4d86-8630-2efc457c49ad req-f8cbc02c-2a89-4d1f-9374-b32ee11d23f7 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received unexpected event network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f for instance with vm_state building and task_state spawning.
Aug 09 19:29:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG nova.virt.images [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] 7973d683-018e-4cd6-a6e2-9e604f89a0e0 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:29:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.part /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.part /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.converted" returned: 0 in 0.190s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced.converted --force-share --output=json" returned: 0 in 0.367s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "79c84aea9a735ade76614eebcb753fd962a72ced" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.636s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "79c84aea9a735ade76614eebcb753fd962a72ced" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "79c84aea9a735ade76614eebcb753fd962a72ced" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced,backing_fmt=raw /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced,backing_fmt=raw /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk 1073741824" returned: 0 in 0.058s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "79c84aea9a735ade76614eebcb753fd962a72ced" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Successfully updated port: 5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-changed-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Refreshing instance network info cache due to event network-changed-5ed3ea7c-cbca-4005-a604-0e328b81513f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] Acquiring lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] Acquired lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Refreshing network info cache for port 5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'migration_context' on Instance uuid 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Ensure instance console log exists: /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-275bb682-62c9-41ae-b192-4f4a4bf81111 req-0a9bafd1-5a54-4e92-8e14-f2bd76f9a290 service nova] Releasing lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquired lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609355.2898846, b16971a4-7b23-4959-a1f4-fa6dd41607b9 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] VM Resumed (Lifecycle Event)
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Instance spawned successfully.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609355.2927017, b16971a4-7b23-4959-a1f4-fa6dd41607b9 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] VM Started (Lifecycle Event)
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating instance_info_cache with network_info: [{"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Releasing lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Instance network_info: |[{"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Start _get_guest_xml network_info=[{"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7f39695f65ee1dd53ef32d18168364f7',container_format='bare',created_at=2023-08-09T19:29:03Z,direct_url=<?>,disk_format='qcow2',id=7973d683-018e-4cd6-a6e2-9e604f89a0e0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1737691400',owner='c95e03143adf4a188effce696ecaf244',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T19:29:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '7973d683-018e-4cd6-a6e2-9e604f89a0e0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:29:15 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:15 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-39924fec-2b89-4540-baa8-167fb3d04702 req-3a874bee-a2e4-4372-b0b2-e16810fbe7fc service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-39924fec-2b89-4540-baa8-167fb3d04702 req-3a874bee-a2e4-4372-b0b2-e16810fbe7fc service nova] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-39924fec-2b89-4540-baa8-167fb3d04702 req-3a874bee-a2e4-4372-b0b2-e16810fbe7fc service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-39924fec-2b89-4540-baa8-167fb3d04702 req-3a874bee-a2e4-4372-b0b2-e16810fbe7fc service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-39924fec-2b89-4540-baa8-167fb3d04702 req-3a874bee-a2e4-4372-b0b2-e16810fbe7fc service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] No waiting events found dispatching network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:15 user nova-compute[72441]: WARNING nova.compute.manager [req-39924fec-2b89-4540-baa8-167fb3d04702 req-3a874bee-a2e4-4372-b0b2-e16810fbe7fc service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received unexpected event network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f for instance with vm_state building and task_state spawning.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7f39695f65ee1dd53ef32d18168364f7',container_format='bare',created_at=2023-08-09T19:29:03Z,direct_url=<?>,disk_format='qcow2',id=7973d683-018e-4cd6-a6e2-9e604f89a0e0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1737691400',owner='c95e03143adf4a188effce696ecaf244',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T19:29:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-84698065',display_name='tempest-TestStampPattern-server-84698065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84698065',id=34,image_ref='7973d683-018e-4cd6-a6e2-9e604f89a0e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrZgsijdle9BxvNJuBPf63kpk37GnI0XlUYU0jMHx4vZWwSi+hR41qeqRkciRtRDBfWnZJN+03hS+rGqu74YCdieaN7fN/ECz92zd+TDLdOM4ym5bqAfpDpTlNUP1DeQ==',key_name='tempest-TestStampPattern-2101327217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95e03143adf4a188effce696ecaf244',ramdisk_id='',reservation_id='r-8xgyzchd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6294a114-45f2-45f4-bfd3-a99fd3c7b61d',image_min_disk='1',image_min_ram='0',image_owner_id='c95e03143adf4a188effce696ecaf244',image_owner_project_name='tempest-TestStampPattern-907520302',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-907520302-project-member',image_user_id='a35ddca8c3c14cd0bde36db805885145',network_allocated='True',owner_project_name='tempest-TestStampPattern-907520302',owner_user_name='tempest-TestStampPattern-907520302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:13Z,user_data=None,user_id='a35ddca8c3c14cd0bde36db805885145',uuid=1c55ec4d-b0b1-4c23-b0aa-5531e169db3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converting VIF {"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:15 user nova-compute[72441]: INFO nova.compute.manager [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Took 7.37 seconds to build instance.
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:29:15 user nova-compute[72441]:   <uuid>1c55ec4d-b0b1-4c23-b0aa-5531e169db3b</uuid>
Aug 09 19:29:15 user nova-compute[72441]:   <name>instance-00000022</name>
Aug 09 19:29:15 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:29:15 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:29:15 user nova-compute[72441]:   <metadata>
Aug 09 19:29:15 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:29:15 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:29:15 user nova-compute[72441]:       <nova:name>tempest-TestStampPattern-server-84698065</nova:name>
Aug 09 19:29:15 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:29:15</nova:creationTime>
Aug 09 19:29:15 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:29:15 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:29:15 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:29:15 user nova-compute[72441]:       <nova:owner>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:user uuid="a35ddca8c3c14cd0bde36db805885145">tempest-TestStampPattern-907520302-project-member</nova:user>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:project uuid="c95e03143adf4a188effce696ecaf244">tempest-TestStampPattern-907520302</nova:project>
Aug 09 19:29:15 user nova-compute[72441]:       </nova:owner>
Aug 09 19:29:15 user nova-compute[72441]:       <nova:root type="image" uuid="7973d683-018e-4cd6-a6e2-9e604f89a0e0"/>
Aug 09 19:29:15 user nova-compute[72441]:       <nova:ports>
Aug 09 19:29:15 user nova-compute[72441]:         <nova:port uuid="5ed3ea7c-cbca-4005-a604-0e328b81513f">
Aug 09 19:29:15 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:29:15 user nova-compute[72441]:         </nova:port>
Aug 09 19:29:15 user nova-compute[72441]:       </nova:ports>
Aug 09 19:29:15 user nova-compute[72441]:     </nova:instance>
Aug 09 19:29:15 user nova-compute[72441]:   </metadata>
Aug 09 19:29:15 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:29:15 user nova-compute[72441]:     <system>
Aug 09 19:29:15 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:29:15 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:29:15 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:29:15 user nova-compute[72441]:       <entry name="serial">1c55ec4d-b0b1-4c23-b0aa-5531e169db3b</entry>
Aug 09 19:29:15 user nova-compute[72441]:       <entry name="uuid">1c55ec4d-b0b1-4c23-b0aa-5531e169db3b</entry>
Aug 09 19:29:15 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:29:15 user nova-compute[72441]:     </system>
Aug 09 19:29:15 user nova-compute[72441]:   </sysinfo>
Aug 09 19:29:15 user nova-compute[72441]:   <os>
Aug 09 19:29:15 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:29:15 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:29:15 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:29:15 user nova-compute[72441]:   </os>
Aug 09 19:29:15 user nova-compute[72441]:   <features>
Aug 09 19:29:15 user nova-compute[72441]:     <acpi/>
Aug 09 19:29:15 user nova-compute[72441]:     <apic/>
Aug 09 19:29:15 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:29:15 user nova-compute[72441]:   </features>
Aug 09 19:29:15 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:29:15 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:29:15 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:29:15 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:29:15 user nova-compute[72441]:   </clock>
Aug 09 19:29:15 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:29:15 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:29:15 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:29:15 user nova-compute[72441]:   </cpu>
Aug 09 19:29:15 user nova-compute[72441]:   <devices>
Aug 09 19:29:15 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:29:15 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:29:15 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk"/>
Aug 09 19:29:15 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:29:15 user nova-compute[72441]:     </disk>
Aug 09 19:29:15 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:29:15 user nova-compute[72441]:       <mac address="fa:16:3e:5d:ea:f3"/>
Aug 09 19:29:15 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:29:15 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:29:15 user nova-compute[72441]:       <target dev="tap5ed3ea7c-cb"/>
Aug 09 19:29:15 user nova-compute[72441]:     </interface>
Aug 09 19:29:15 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:29:15 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/console.log" append="off"/>
Aug 09 19:29:15 user nova-compute[72441]:     </serial>
Aug 09 19:29:15 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:29:15 user nova-compute[72441]:     <video>
Aug 09 19:29:15 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:29:15 user nova-compute[72441]:     </video>
Aug 09 19:29:15 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:29:15 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:29:15 user nova-compute[72441]:     </rng>
Aug 09 19:29:15 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:29:15 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:29:15 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:29:15 user nova-compute[72441]:     </memballoon>
Aug 09 19:29:15 user nova-compute[72441]:   </devices>
Aug 09 19:29:15 user nova-compute[72441]: </domain>
Aug 09 19:29:15 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-84698065',display_name='tempest-TestStampPattern-server-84698065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84698065',id=34,image_ref='7973d683-018e-4cd6-a6e2-9e604f89a0e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrZgsijdle9BxvNJuBPf63kpk37GnI0XlUYU0jMHx4vZWwSi+hR41qeqRkciRtRDBfWnZJN+03hS+rGqu74YCdieaN7fN/ECz92zd+TDLdOM4ym5bqAfpDpTlNUP1DeQ==',key_name='tempest-TestStampPattern-2101327217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95e03143adf4a188effce696ecaf244',ramdisk_id='',reservation_id='r-8xgyzchd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6294a114-45f2-45f4-bfd3-a99fd3c7b61d',image_min_disk='1',image_min_ram='0',image_owner_id='c95e03143adf4a188effce696ecaf244',image_owner_project_name='tempest-TestStampPattern-907520302',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-907520302-project-member',image_user_id='a35ddca8c3c14cd0bde36db805885145',network_allocated='True',owner_project_name='tempest-TestStampPattern-907520302',owner_user_name='tempest-TestStampPattern-907520302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:13Z,user_data=None,user_id='a35ddca8c3c14cd0bde36db805885145',uuid=1c55ec4d-b0b1-4c23-b0aa-5531e169db3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converting VIF {"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG os_vif [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed3ea7c-cb, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ed3ea7c-cb, col_values=(('external_ids', {'iface-id': '5ed3ea7c-cbca-4005-a604-0e328b81513f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ea:f3', 'vm-uuid': '1c55ec4d-b0b1-4c23-b0aa-5531e169db3b'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fb336b09-1da8-4fc2-9679-a117e215c0ad tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.491s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:15 user nova-compute[72441]: INFO os_vif [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb')
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:29:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No VIF found with MAC fa:16:3e:5d:ea:f3, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:29:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-3b433882-5e9e-442c-8fe5-69e3f45b76ff req-637277c9-8f1b-4a24-b7f2-2dc17fc55a5f service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3b433882-5e9e-442c-8fe5-69e3f45b76ff req-637277c9-8f1b-4a24-b7f2-2dc17fc55a5f service nova] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3b433882-5e9e-442c-8fe5-69e3f45b76ff req-637277c9-8f1b-4a24-b7f2-2dc17fc55a5f service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3b433882-5e9e-442c-8fe5-69e3f45b76ff req-637277c9-8f1b-4a24-b7f2-2dc17fc55a5f service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-3b433882-5e9e-442c-8fe5-69e3f45b76ff req-637277c9-8f1b-4a24-b7f2-2dc17fc55a5f service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] No waiting events found dispatching network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:17 user nova-compute[72441]: WARNING nova.compute.manager [req-3b433882-5e9e-442c-8fe5-69e3f45b76ff req-637277c9-8f1b-4a24-b7f2-2dc17fc55a5f service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received unexpected event network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f for instance with vm_state building and task_state spawning.
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609359.5050755, 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:19 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] VM Resumed (Lifecycle Event)
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:29:19 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Instance spawned successfully.
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-fa0142b5-d19b-4a10-8d6e-4ff8f1051efa req-5e5aec0d-d5e1-4555-a466-d63725c5bfbd service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fa0142b5-d19b-4a10-8d6e-4ff8f1051efa req-5e5aec0d-d5e1-4555-a466-d63725c5bfbd service nova] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fa0142b5-d19b-4a10-8d6e-4ff8f1051efa req-5e5aec0d-d5e1-4555-a466-d63725c5bfbd service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fa0142b5-d19b-4a10-8d6e-4ff8f1051efa req-5e5aec0d-d5e1-4555-a466-d63725c5bfbd service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-fa0142b5-d19b-4a10-8d6e-4ff8f1051efa req-5e5aec0d-d5e1-4555-a466-d63725c5bfbd service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] No waiting events found dispatching network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:19 user nova-compute[72441]: WARNING nova.compute.manager [req-fa0142b5-d19b-4a10-8d6e-4ff8f1051efa req-5e5aec0d-d5e1-4555-a466-d63725c5bfbd service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received unexpected event network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f for instance with vm_state building and task_state spawning.
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:19 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609359.5077796, 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:19 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] VM Started (Lifecycle Event)
Aug 09 19:29:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:20 user nova-compute[72441]: INFO nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Took 7.37 seconds to spawn the instance on the hypervisor.
Aug 09 19:29:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:20 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:29:20 user nova-compute[72441]: INFO nova.compute.manager [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Took 8.40 seconds to build instance.
Aug 09 19:29:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1964ecd4-a04f-4514-9cd2-f51a169623d7 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.503s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91cdce3-48cf-4a94-8963-b45820dbd108]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64f9b2-8d1b-44fc-98a2-078a06afb80a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.052s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570576e-db3d-4046-860e-0e83dfcca986]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92a42ae-c16c-4ea1-91a5-da3871487cc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:29:21 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[028bf9aa-0e26-4378-b4d0-e739497d69de]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updating existing volume attachment record: 27439968-2289-428a-b2f0-ae20474d99b9 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing instance network info cache due to event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:21 user nova-compute[72441]: DEBUG nova.network.neutron [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updated VIF entry in instance network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a034a78-c2bd-42f3-93ca-3c1d1b6d7bdd req-6bb4971b-7fc2-43bb-b432-cd9c13b07120 service nova] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing instance network info cache due to event network-changed-457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] Acquiring lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] Acquired lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Refreshing network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:23 user nova-compute[72441]: INFO nova.compute.manager [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Detaching volume 2a46028f-a19c-43de-9d7c-ee01eb55df17
Aug 09 19:29:23 user nova-compute[72441]: INFO nova.virt.block_device [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Attempting to driver detach volume 2a46028f-a19c-43de-9d7c-ee01eb55df17 from mountpoint /dev/vdb
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Attempting to detach device vdb from instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:29:23 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:29:23 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:29:23 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:29:23 user nova-compute[72441]:   <serial>2a46028f-a19c-43de-9d7c-ee01eb55df17</serial>
Aug 09 19:29:23 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:29:23 user nova-compute[72441]: </disk>
Aug 09 19:29:23 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:29:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully detached device vdb from instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea from the persistent domain config.
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:29:23 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:29:23 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:29:23 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:29:23 user nova-compute[72441]:   <serial>2a46028f-a19c-43de-9d7c-ee01eb55df17</serial>
Aug 09 19:29:23 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:29:23 user nova-compute[72441]: </disk>
Aug 09 19:29:23 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updated VIF entry in instance network info cache for port 457692b8-151c-4048-9fb4-1ff0f6566699. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [{"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d014340c-c6fb-4e80-8498-273b23613451 req-a2a4df37-e3fa-4b60-8821-0b80286ff4e7 service nova] Releasing lock "refresh_cache-2ee4681e-d00f-47af-8b44-e4f8986b60ea" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609364.1220753, 2ee4681e-d00f-47af-8b44-e4f8986b60ea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:29:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully detached device vdb from instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea from the live domain config.
Aug 09 19:29:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLDkQRWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:29:24 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f62342-d9b5-48a7-9685-a6543baa9e86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7ee09-adcb-4572-b84f-1fb9d6f2d894]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:29:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9835df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a8020-34af-4b54-a672-147fb8de800f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84840b5-f5ba-4e61-9c57-80029694b4a8]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1103e-66ea-47d8-b707-f7b248dec778]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0d9ed-0efb-4d0d-ad04-73f40b1128d7]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[39747206-e94b-4120-9185-d479ba415764]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c660031-7652-4a66-9427-f24791d1765d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260]
Aug 09 19:29:24 user nova-compute[72441]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17, portal: 172.16.0.220,3260] successful.
Aug 09 19:29:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a46028f-a19c-43de-9d7c-ee01eb55df17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4711d0f-a0d7-4fd3-a9cf-277b9776b4a8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] <== disconnect_volume: return (327ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:29:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:29:25 user nova-compute[72441]: DEBUG nova.objects.instance [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'flavor' on Instance uuid 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-83a28b7a-314c-424e-bef7-f19530e53304 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:25 user nova-compute[72441]: INFO nova.compute.manager [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Unrescuing
Aug 09 19:29:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'flavor' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-26800119-7b20-4a27-9320-95e847f58490 req-94c0cbed-5e92-4786-ab7d-6e09800d39ff service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-26800119-7b20-4a27-9320-95e847f58490 req-94c0cbed-5e92-4786-ab7d-6e09800d39ff service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-26800119-7b20-4a27-9320-95e847f58490 req-94c0cbed-5e92-4786-ab7d-6e09800d39ff service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-26800119-7b20-4a27-9320-95e847f58490 req-94c0cbed-5e92-4786-ab7d-6e09800d39ff service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-26800119-7b20-4a27-9320-95e847f58490 req-94c0cbed-5e92-4786-ab7d-6e09800d39ff service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:26 user nova-compute[72441]: WARNING nova.compute.manager [req-26800119-7b20-4a27-9320-95e847f58490 req-94c0cbed-5e92-4786-ab7d-6e09800d39ff service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance destroyed successfully.
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:29 user nova-compute[72441]: WARNING nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:29 user nova-compute[72441]: WARNING nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:29 user nova-compute[72441]: WARNING nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:29 user nova-compute[72441]: WARNING nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:29 user nova-compute[72441]: WARNING nova.compute.manager [req-cf93d76a-33f9-48ca-9844-ba43ccc9a144 req-4d643eb1-786b-413e-90c0-b0a7932bd9b8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:31 user nova-compute[72441]: WARNING nova.compute.manager [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:31 user nova-compute[72441]: WARNING nova.compute.manager [req-ef4ae098-61fb-4fd0-85c8-cc89e8c5870c req-193d1bb8-3802-4adf-8b18-97cfce9b3cf8 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for e30cf305-f264-4aab-a4cf-f555a57e8db3 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609371.268815, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Resumed (Lifecycle Event)
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b4166fe8-7fc5-4313-b748-d60c0efc1218 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609371.2700799, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Started (Lifecycle Event)
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:29:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Creating image(s)
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Start _get_guest_xml network_info=[{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4dd294f-e0ff-41f7-a717-1b383d10b00e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd370af45-3cdf-460c-9bdb-087b5cb54a5d', 'serial': 'd370af45-3cdf-460c-9bdb-087b5cb54a5d'}, 'attachment_id': '27439968-2289-428a-b2f0-ae20474d99b9', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:29:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:32 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:29:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:29:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:29:32 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a603fb2-8c5b-44e4-8366-4cf98be9d118]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:29:32 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924cba9-a71b-40a3-9dce-3065c0fd4166]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d] added
Aug 09 19:29:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c07254-0751-4113-89cb-c8553b883fea]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ee3d67-ec72-4fc0-acff-ff8fcc38b7a1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRZUywHO {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRZUywHO" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635f5b2-629b-435d-8a4e-7d2524576b06]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lRZUywHO'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaebd3a-4e78-4bd2-a697-5c4427ca192b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb885d-7f13-44ea-8697-def03d9a168c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db122b7-87af-45ab-8494-2710d7d8eb08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260]
Aug 09 19:29:32 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260] successful.
Aug 09 19:29:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b70276-1070-4252-9994-24f6b9099ca6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7962029b-105a-46a5-bc58-fc60b77a477c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:29:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:29:32 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:29:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12df6310-824b-4bde-8702-29c6b3d00c29]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26664326165353362', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664326165353362', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2002161486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2002161486',id=32,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-yl09rnos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:00Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=a4dd294f-e0ff-41f7-a717-1b383d10b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'pci_devices' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:29:33 user nova-compute[72441]:   <uuid>a4dd294f-e0ff-41f7-a717-1b383d10b00e</uuid>
Aug 09 19:29:33 user nova-compute[72441]:   <name>instance-00000020</name>
Aug 09 19:29:33 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:29:33 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:29:33 user nova-compute[72441]:   <metadata>
Aug 09 19:29:33 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:29:33 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:29:33 user nova-compute[72441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2002161486</nova:name>
Aug 09 19:29:33 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:29:32</nova:creationTime>
Aug 09 19:29:33 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:29:33 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:29:33 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:29:33 user nova-compute[72441]:       <nova:owner>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:user uuid="554ea2267ce94d618fbd7ef211cb7b51">tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member</nova:user>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:project uuid="e0d7a9e68495428292b9417ee4b234ad">tempest-ServerBootFromVolumeStableRescueTest-1993502489</nova:project>
Aug 09 19:29:33 user nova-compute[72441]:       </nova:owner>
Aug 09 19:29:33 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:29:33 user nova-compute[72441]:       <nova:ports>
Aug 09 19:29:33 user nova-compute[72441]:         <nova:port uuid="e1b085d4-02b4-411f-bd06-b5f200ef8540">
Aug 09 19:29:33 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 19:29:33 user nova-compute[72441]:         </nova:port>
Aug 09 19:29:33 user nova-compute[72441]:       </nova:ports>
Aug 09 19:29:33 user nova-compute[72441]:     </nova:instance>
Aug 09 19:29:33 user nova-compute[72441]:   </metadata>
Aug 09 19:29:33 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:29:33 user nova-compute[72441]:     <system>
Aug 09 19:29:33 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:29:33 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:29:33 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:29:33 user nova-compute[72441]:       <entry name="serial">a4dd294f-e0ff-41f7-a717-1b383d10b00e</entry>
Aug 09 19:29:33 user nova-compute[72441]:       <entry name="uuid">a4dd294f-e0ff-41f7-a717-1b383d10b00e</entry>
Aug 09 19:29:33 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:29:33 user nova-compute[72441]:     </system>
Aug 09 19:29:33 user nova-compute[72441]:   </sysinfo>
Aug 09 19:29:33 user nova-compute[72441]:   <os>
Aug 09 19:29:33 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:29:33 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:29:33 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:29:33 user nova-compute[72441]:   </os>
Aug 09 19:29:33 user nova-compute[72441]:   <features>
Aug 09 19:29:33 user nova-compute[72441]:     <acpi/>
Aug 09 19:29:33 user nova-compute[72441]:     <apic/>
Aug 09 19:29:33 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:29:33 user nova-compute[72441]:   </features>
Aug 09 19:29:33 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:29:33 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:29:33 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:29:33 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:29:33 user nova-compute[72441]:   </clock>
Aug 09 19:29:33 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:29:33 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:29:33 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:29:33 user nova-compute[72441]:   </cpu>
Aug 09 19:29:33 user nova-compute[72441]:   <devices>
Aug 09 19:29:33 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:29:33 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:29:33 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:29:33 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:29:33 user nova-compute[72441]:       <serial>d370af45-3cdf-460c-9bdb-087b5cb54a5d</serial>
Aug 09 19:29:33 user nova-compute[72441]:     </disk>
Aug 09 19:29:33 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:29:33 user nova-compute[72441]:       <mac address="fa:16:3e:6c:50:7b"/>
Aug 09 19:29:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:29:33 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:29:33 user nova-compute[72441]:       <target dev="tape1b085d4-02"/>
Aug 09 19:29:33 user nova-compute[72441]:     </interface>
Aug 09 19:29:33 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:29:33 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/console.log" append="off"/>
Aug 09 19:29:33 user nova-compute[72441]:     </serial>
Aug 09 19:29:33 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:29:33 user nova-compute[72441]:     <video>
Aug 09 19:29:33 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:29:33 user nova-compute[72441]:     </video>
Aug 09 19:29:33 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:29:33 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:29:33 user nova-compute[72441]:     </rng>
Aug 09 19:29:33 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:29:33 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:29:33 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:29:33 user nova-compute[72441]:     </memballoon>
Aug 09 19:29:33 user nova-compute[72441]:   </devices>
Aug 09 19:29:33 user nova-compute[72441]: </domain>
Aug 09 19:29:33 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2002161486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2002161486',id=32,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-yl09rnos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:00Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=a4dd294f-e0ff-41f7-a717-1b383d10b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG os_vif [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1b085d4-02, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1b085d4-02, col_values=(('external_ids', {'iface-id': 'e1b085d4-02b4-411f-bd06-b5f200ef8540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:50:7b', 'vm-uuid': 'a4dd294f-e0ff-41f7-a717-1b383d10b00e'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:33 user nova-compute[72441]: INFO os_vif [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02')
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No VIF found with MAC fa:16:3e:6c:50:7b, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-801d3fa6-8501-46cb-886b-9f4633556374 req-46949a78-6636-4478-9eec-14ce0c619ee3 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-801d3fa6-8501-46cb-886b-9f4633556374 req-46949a78-6636-4478-9eec-14ce0c619ee3 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-801d3fa6-8501-46cb-886b-9f4633556374 req-46949a78-6636-4478-9eec-14ce0c619ee3 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-801d3fa6-8501-46cb-886b-9f4633556374 req-46949a78-6636-4478-9eec-14ce0c619ee3 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-801d3fa6-8501-46cb-886b-9f4633556374 req-46949a78-6636-4478-9eec-14ce0c619ee3 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:35 user nova-compute[72441]: WARNING nova.compute.manager [req-801d3fa6-8501-46cb-886b-9f4633556374 req-46949a78-6636-4478-9eec-14ce0c619ee3 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state building and task_state spawning.
Aug 09 19:29:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-584dc533-c016-4bbb-af7a-cdb7eecf6e12 req-bc87d66c-7132-4b5d-9441-07593d09ea91 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-584dc533-c016-4bbb-af7a-cdb7eecf6e12 req-bc87d66c-7132-4b5d-9441-07593d09ea91 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-584dc533-c016-4bbb-af7a-cdb7eecf6e12 req-bc87d66c-7132-4b5d-9441-07593d09ea91 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-584dc533-c016-4bbb-af7a-cdb7eecf6e12 req-bc87d66c-7132-4b5d-9441-07593d09ea91 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [req-584dc533-c016-4bbb-af7a-cdb7eecf6e12 req-bc87d66c-7132-4b5d-9441-07593d09ea91 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:29:37 user nova-compute[72441]: WARNING nova.compute.manager [req-584dc533-c016-4bbb-af7a-cdb7eecf6e12 req-bc87d66c-7132-4b5d-9441-07593d09ea91 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state building and task_state spawning.
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609377.546838, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Resumed (Lifecycle Event)
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance spawned successfully.
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609377.5508664, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Started (Lifecycle Event)
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 09 19:29:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:29:37 user nova-compute[72441]: INFO nova.compute.manager [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Took 38.53 seconds to build instance.
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:29:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cbcb6641-2751-4914-9c57-0aab47e3e3be tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.651s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6643MB free_disk=24.931934356689453GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Applying migration context for instance bb15c890-ce98-4e03-811f-8459d12120f8 as it has an incoming, in-progress migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe. Migration status is finished {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 19:29:38 user nova-compute[72441]: INFO nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating resource usage from migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 471adda1-bc0b-42e6-9476-206c9ec9b58f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance a4dd294f-e0ff-41f7-a717-1b383d10b00e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:29:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:29:39 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:29:39 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:29:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:29:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.048s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:29:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:29:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-changed-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Refreshing instance network info cache due to event network-changed-2f79ca90-0705-4b5f-a9e1-39b74bc865f1. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] Acquiring lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] Acquired lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG nova.network.neutron [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Refreshing network info cache for port 2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG nova.network.neutron [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updated VIF entry in instance network info cache for port 2f79ca90-0705-4b5f-a9e1-39b74bc865f1. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG nova.network.neutron [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updating instance_info_cache with network_info: [{"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:29:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1da2caa2-f6e3-4182-8353-b654e5997df3 req-5ec7cf23-2b1a-4918-b405-bb482a72f290 service nova] Releasing lock "refresh_cache-2b3a4c39-be92-42c6-86ec-8fcb5447b577" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:29:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing instance network info cache due to event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:01 user nova-compute[72441]: INFO nova.compute.manager [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Attaching volume e83887b9-7b5e-4dab-895e-7a5080732167 to /dev/vdb
Aug 09 19:30:01 user nova-compute[72441]: DEBUG os_brick.utils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58251fc-83d4-43d1-bde2-1148581167f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b8d1f-7fd7-4af0-9b1f-79fc6c0944f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[af82bb66-6a26-4b29-8b26-870bf3fc75f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bdd67d-99fc-4d47-9a2b-20b36a5b32e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:30:01 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:30:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e32b059-9808-4ce4-a168-6c536101c0c1]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG os_brick.utils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updating existing volume attachment record: 94123975-8171-4de2-a9b0-58148d5233d4 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updated VIF entry in instance network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:30:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-05effc85-efcc-4512-8cc2-4ac0cc731f2d req-f5bbc957-5cad-4c83-8ab3-2c34bf053280 service nova] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:30:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:06 user nova-compute[72441]: INFO nova.compute.manager [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Shelving
Aug 09 19:30:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-94f62b02-582e-40d5-8497-54853858995f req-eb2038b1-175d-4a94-a480-cd35ed0984e8 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-unplugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-94f62b02-582e-40d5-8497-54853858995f req-eb2038b1-175d-4a94-a480-cd35ed0984e8 service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-94f62b02-582e-40d5-8497-54853858995f req-eb2038b1-175d-4a94-a480-cd35ed0984e8 service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-94f62b02-582e-40d5-8497-54853858995f req-eb2038b1-175d-4a94-a480-cd35ed0984e8 service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-94f62b02-582e-40d5-8497-54853858995f req-eb2038b1-175d-4a94-a480-cd35ed0984e8 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-unplugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:06 user nova-compute[72441]: WARNING nova.compute.manager [req-94f62b02-582e-40d5-8497-54853858995f req-eb2038b1-175d-4a94-a480-cd35ed0984e8 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-unplugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state active and task_state shelving.
Aug 09 19:30:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance destroyed successfully.
Aug 09 19:30:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Beginning cold snapshot process
Aug 09 19:30:07 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:30:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk /opt/stack/data/nova/instances/snapshots/tmpanx56bce/debd16bfdafd487d862c42ceb469ea89 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk /opt/stack/data/nova/instances/snapshots/tmpanx56bce/debd16bfdafd487d862c42ceb469ea89" returned: 0 in 0.818s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:07 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Snapshot extracted, beginning image upload
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:08 user nova-compute[72441]: INFO nova.compute.manager [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Terminating instance
Aug 09 19:30:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-32eefa8e-c28b-4601-8028-946cfcf62b2b req-ea02283f-40b1-44b2-a115-d1baaf3f1c3b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-32eefa8e-c28b-4601-8028-946cfcf62b2b req-ea02283f-40b1-44b2-a115-d1baaf3f1c3b service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-32eefa8e-c28b-4601-8028-946cfcf62b2b req-ea02283f-40b1-44b2-a115-d1baaf3f1c3b service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-32eefa8e-c28b-4601-8028-946cfcf62b2b req-ea02283f-40b1-44b2-a115-d1baaf3f1c3b service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-32eefa8e-c28b-4601-8028-946cfcf62b2b req-ea02283f-40b1-44b2-a115-d1baaf3f1c3b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:08 user nova-compute[72441]: WARNING nova.compute.manager [req-32eefa8e-c28b-4601-8028-946cfcf62b2b req-ea02283f-40b1-44b2-a115-d1baaf3f1c3b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 19:30:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-0cf7d9a9-5a28-4d3b-9cf2-ac3dd863fd88 req-a05a719a-b1e3-4093-80cd-cae52f2ff50e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0cf7d9a9-5a28-4d3b-9cf2-ac3dd863fd88 req-a05a719a-b1e3-4093-80cd-cae52f2ff50e service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0cf7d9a9-5a28-4d3b-9cf2-ac3dd863fd88 req-a05a719a-b1e3-4093-80cd-cae52f2ff50e service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0cf7d9a9-5a28-4d3b-9cf2-ac3dd863fd88 req-a05a719a-b1e3-4093-80cd-cae52f2ff50e service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-0cf7d9a9-5a28-4d3b-9cf2-ac3dd863fd88 req-a05a719a-b1e3-4093-80cd-cae52f2ff50e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-0cf7d9a9-5a28-4d3b-9cf2-ac3dd863fd88 req-a05a719a-b1e3-4093-80cd-cae52f2ff50e service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-unplugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:30:09 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Instance destroyed successfully.
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lazy-loading 'resources' on Instance uuid 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-744398493',display_name='tempest-ServerActionsTestOtherB-server-744398493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-744398493',id=17,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN//wCoPaswP9QQNiq2KCd9nu/pJu2PyM2eAMzZ4m728SGZOrdFzRbrIbC3jawEGv97BVPlUyU0FSXT90WjaIb7K2PaYdPvTDtkBqoAphV/z4WBG55eHx7e51YpAaq4ISw==',key_name='tempest-keypair-682300832',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:27:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4468899cba1a4bfe8a68af07b58b0a04',ramdisk_id='',reservation_id='r-zroi4ej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-804828463',owner_user_name='tempest-ServerActionsTestOtherB-804828463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de57b5e4f9f54fffa53d91f9a6afd092',uuid=33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converting VIF {"id": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "address": "fa:16:3e:d6:d5:a3", "network": {"id": "2e843a46-7dc8-4449-8d85-a5d8f57d91c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2087673283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468899cba1a4bfe8a68af07b58b0a04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cacd5ec-a1", "ovs_interfaceid": "2cacd5ec-a169-42d7-b356-5878fa2373ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_vif [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cacd5ec-a1, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:09 user nova-compute[72441]: INFO os_vif [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:a3,bridge_name='br-int',has_traffic_filtering=True,id=2cacd5ec-a169-42d7-b356-5878fa2373ed,network=Network(2e843a46-7dc8-4449-8d85-a5d8f57d91c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cacd5ec-a1')
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heCywOBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:30:09 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d32c0c-9d8d-4a39-b41f-0cfe16e43735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be048b-91e9-414b-a843-7f9ea950dc1c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:09 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:30:09 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:09 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:09 user nova-compute[72441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 (non-flash)
Aug 09 19:30:09 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:09 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9056e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1a380-20d4-49e6-b6ea-5798d92c5f10]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e694c50-23c1-4e5a-a4b8-e4c59fd14575]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7240de-1df0-4c6c-aea6-3280649f4a1f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85bb2b7-dba1-43eb-8fb2-a76608918bc1]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75e6f3c-a98a-4ade-b6e8-b4c21f9dfe9f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f126b2-3bac-4f96-a2ca-b56c8f19eeca]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260]
Aug 09 19:30:09 user nova-compute[72441]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549, portal: 172.16.0.220,3260] successful.
Aug 09 19:30:09 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc1d96-f0e4-4eda-bec5-b51a8582e549 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73176610-fbb0-4b4c-bd65-195cc7ef82a7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] <== disconnect_volume: return (315ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:30:09 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Deleting instance files /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c_del
Aug 09 19:30:09 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Deletion of /opt/stack/data/nova/instances/33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c_del complete
Aug 09 19:30:09 user nova-compute[72441]: INFO nova.compute.manager [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 19:30:09 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:30:09 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:30:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Snapshot image upload complete
Aug 09 19:30:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:10 user nova-compute[72441]: INFO nova.compute.manager [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Shelve offloading
Aug 09 19:30:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance destroyed successfully.
Aug 09 19:30:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-fd47bcd1-97d4-4a6d-aaf0-cdf5eb4ffd0c req-d7f39e75-20a6-4331-8d11-e2bc89d6eb34 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fd47bcd1-97d4-4a6d-aaf0-cdf5eb4ffd0c req-d7f39e75-20a6-4331-8d11-e2bc89d6eb34 service nova] Acquiring lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fd47bcd1-97d4-4a6d-aaf0-cdf5eb4ffd0c req-d7f39e75-20a6-4331-8d11-e2bc89d6eb34 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fd47bcd1-97d4-4a6d-aaf0-cdf5eb4ffd0c req-d7f39e75-20a6-4331-8d11-e2bc89d6eb34 service nova] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-fd47bcd1-97d4-4a6d-aaf0-cdf5eb4ffd0c req-d7f39e75-20a6-4331-8d11-e2bc89d6eb34 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] No waiting events found dispatching network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:10 user nova-compute[72441]: WARNING nova.compute.manager [req-fd47bcd1-97d4-4a6d-aaf0-cdf5eb4ffd0c req-d7f39e75-20a6-4331-8d11-e2bc89d6eb34 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received unexpected event network-vif-plugged-2cacd5ec-a169-42d7-b356-5878fa2373ed for instance with vm_state active and task_state deleting.
Aug 09 19:30:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyrqnGsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:30:11 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:30:11 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:30:11 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[60406d88-94f3-42c5-8548-ed039637a17a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:30:11 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d20d44-9d5f-470c-9ee9-4a56f9dea4d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167] added
Aug 09 19:30:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98e5434-8571-4cb7-a430-a2f5a13d65bf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b921478-5bd4-4b0a-8b77-62cc8ade8184]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyrqnGsB {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyrqnGsB" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c5677-14f7-4773-b84e-182a941845b0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gyrqnGsB'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8931aa-1712-40d0-9d3c-1fc02e5205fe]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f02c40-436f-4cbf-91b0-e9c49ff1e593]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:11 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Took 1.45 seconds to deallocate network for instance.
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-678b5cbb-ad69-4538-a3f1-51cda147c769 req-c66056b8-e078-41cd-9ff6-31c716a3c586 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Received event network-vif-deleted-2cacd5ec-a169-42d7-b356-5878fa2373ed {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:11 user nova-compute[72441]: INFO nova.compute.manager [req-678b5cbb-ad69-4538-a3f1-51cda147c769 req-c66056b8-e078-41cd-9ff6-31c716a3c586 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Neutron deleted interface 2cacd5ec-a169-42d7-b356-5878fa2373ed; detaching it from the instance and deleting it from the info cache
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-678b5cbb-ad69-4538-a3f1-51cda147c769 req-c66056b8-e078-41cd-9ff6-31c716a3c586 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8270a34e-dfb6-43c6-adc9-ccacbe85d709]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260]
Aug 09 19:30:11 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260] successful.
Aug 09 19:30:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-678b5cbb-ad69-4538-a3f1-51cda147c769 req-c66056b8-e078-41cd-9ff6-31c716a3c586 service nova] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Detach interface failed, port_id=2cacd5ec-a169-42d7-b356-5878fa2373ed, reason: Instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4427cdfc-7fb5-42f8-ae46-8388b4f505b0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4319e0fc-7060-47a7-88db-b644ee9ee2f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:11 user nova-compute[72441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 (non-flash)
Aug 09 19:30:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bcad58-c402-481a-a409-e30f72118aaa]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyrqnGsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:30:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance destroyed successfully.
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'resources' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-121406836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-121406836',id=31,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaOjCy7otZPDTbCdIVBaOk1sjHOF0X+g86O3I2SFeW28nsz8beaJ7hQOaJdOgfKXTQiybezEpi3RTHMAohT9IR6pOmSEpJbj25Ui1FOILwGGah+hV5pwYXxHaBdg6ULDQ==',key_name='tempest-keypair-1680402287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-77vjub3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member',shelved_at='2023-08-09T19:30:10.362057',shelved_host='user',shelved_image_id='d050ee19-dcfe-4564-92ab-754d9c0f32c2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=471adda1-bc0b-42e6-9476-206c9ec9b58f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG os_vif [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3a03733-e3, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:11 user nova-compute[72441]: INFO os_vif [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3')
Aug 09 19:30:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Deleting instance files /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f_del
Aug 09 19:30:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Deletion of /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f_del complete
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing instance network info cache due to event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:30:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:30:11 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Deleted allocations for instance 471adda1-bc0b-42e6-9476-206c9ec9b58f
Aug 09 19:30:12 user nova-compute[72441]: INFO nova.compute.manager [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Took 0.78 seconds to detach 1 volumes for instance.
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'numa_topology' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updated VIF entry in instance network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape3a03733-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23632363434306132', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632363434306132', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-df9972da-fbf9-4a93-bef5-b36c3762f6d5 req-64e794dc-9ea1-4c95-b2d3-2b7b63b14123 service nova] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:30:12 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:30:12 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:30:12 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:30:12 user nova-compute[72441]:   <serial>e83887b9-7b5e-4dab-895e-7a5080732167</serial>
Aug 09 19:30:12 user nova-compute[72441]: </disk>
Aug 09 19:30:12 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.446s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6dad73fd-4d19-4379-aa4f-1b6574fc8571 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.434s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] No VIF found with MAC fa:16:3e:fa:fc:e4, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:30:12 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f8cc25de-08bf-41be-b098-87c2a3b3bffc tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.428s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Going to confirm migration 2 {{(pid=72441) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:13 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Deleted allocations for instance 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8dd9614-9f68-485b-92b0-1cd7c3a17a47 tempest-ServerActionsTestOtherB-804828463 tempest-ServerActionsTestOtherB-804828463-project-member] Lock "33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.647s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquired lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'info_cache' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:13 user nova-compute[72441]: INFO nova.compute.manager [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Detaching volume e83887b9-7b5e-4dab-895e-7a5080732167
Aug 09 19:30:13 user nova-compute[72441]: INFO nova.virt.block_device [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Attempting to driver detach volume e83887b9-7b5e-4dab-895e-7a5080732167 from mountpoint /dev/vdb
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Attempting to detach device vdb from instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:30:13 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:30:13 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:30:13 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:30:13 user nova-compute[72441]:   <serial>e83887b9-7b5e-4dab-895e-7a5080732167</serial>
Aug 09 19:30:13 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:30:13 user nova-compute[72441]: </disk>
Aug 09 19:30:13 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:30:13 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully detached device vdb from instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 from the persistent domain config.
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:30:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:30:13 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:30:13 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:30:13 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:30:13 user nova-compute[72441]:   <serial>e83887b9-7b5e-4dab-895e-7a5080732167</serial>
Aug 09 19:30:13 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:30:13 user nova-compute[72441]: </disk>
Aug 09 19:30:13 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [{"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Releasing lock "refresh_cache-bb15c890-ce98-4e03-811f-8459d12120f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'migration_context' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609414.2888808, 2b3a4c39-be92-42c6-86ec-8fcb5447b577 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:30:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully detached device vdb from instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 from the live domain config.
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyrqnGsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:30:14 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3639a55b-a9db-44cf-9b71-6c1a1d6265d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67ca75-5237-4f0b-9a90-848242656f6a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:14 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:14 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:14 user nova-compute[72441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 (non-flash)
Aug 09 19:30:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:14 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:14 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:14 user nova-compute[72441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 (non-flash)
Aug 09 19:30:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90592320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d46807-3df2-44d0-88e6-db0f8c5ab80a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c159e103-47a3-491e-a066-7aaf313f6a5f]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f94c22-6e06-4b4a-b3ca-1ad7554caeb3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66713de9-d58d-4dfb-b86d-fc5162e0f03f]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c0b14-23eb-4ca5-a8dc-c9856e99184d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.482s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea26d0-05b7-40c6-a0fc-7d13c49a1861]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260]
Aug 09 19:30:14 user nova-compute[72441]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167, portal: 172.16.0.220,3260] successful.
Aug 09 19:30:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83887b9-7b5e-4dab-895e-7a5080732167 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2918a3f4-d950-46f3-8c71-d76dd7e3963f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] <== disconnect_volume: return (300ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:30:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:30:14 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Deleted allocation for migration 2db29dbf-0d8c-4e55-bcf9-90f8404d5cbe
Aug 09 19:30:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3e6b48f1-0300-4c46-a9cc-f2cfd3cbf6ab tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.690s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'flavor' on Instance uuid 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6cfe7568-e624-4866-87d7-5fdf3ad3fdd0 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:21 user nova-compute[72441]: INFO nova.compute.manager [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Terminating instance
Aug 09 19:30:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609406.7845151, 471adda1-bc0b-42e6-9476-206c9ec9b58f => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:30:21 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] VM Stopped (Lifecycle Event)
Aug 09 19:30:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-edae99a2-c7e0-4def-a6fd-04fbe6b1bbc1 None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-0f1498f8-7180-4d80-8055-1c525fa89d1c req-e6140ef7-bc24-4916-b8ba-a2c56e24cf87 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-unplugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0f1498f8-7180-4d80-8055-1c525fa89d1c req-e6140ef7-bc24-4916-b8ba-a2c56e24cf87 service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0f1498f8-7180-4d80-8055-1c525fa89d1c req-e6140ef7-bc24-4916-b8ba-a2c56e24cf87 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0f1498f8-7180-4d80-8055-1c525fa89d1c req-e6140ef7-bc24-4916-b8ba-a2c56e24cf87 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-0f1498f8-7180-4d80-8055-1c525fa89d1c req-e6140ef7-bc24-4916-b8ba-a2c56e24cf87 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-unplugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-0f1498f8-7180-4d80-8055-1c525fa89d1c req-e6140ef7-bc24-4916-b8ba-a2c56e24cf87 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-unplugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:30:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Instance destroyed successfully.
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lazy-loading 'resources' on Instance uuid 2ee4681e-d00f-47af-8b44-e4f8986b60ea {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-873284158',display_name='tempest-TestMinimumBasicScenario-server-873284158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-873284158',id=24,image_ref='d0573f7e-8838-47ee-9a0a-eb4d300cbb79',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpv0pDL4fjIA5p88JOG0Zko97M6yAbmAO1BzimpNUc3pb4Klio+f0m7s16o72yHpGJYdcvH0zL+P9w7ost77ehBvO7zqMX5fmZALujWviruFV35eMVWp1AaSG1bhijZsQ==',key_name='tempest-TestMinimumBasicScenario-2076058511',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:25:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c2820770744df88c94474a2ad02e77',ramdisk_id='',reservation_id='r-nhqkm4p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d0573f7e-8838-47ee-9a0a-eb4d300cbb79',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2005926422',owner_user_name='tempest-TestMinimumBasicScenario-2005926422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:27:39Z,user_data=None,user_id='7ba704de696a49258532080173d23fd5',uuid=2ee4681e-d00f-47af-8b44-e4f8986b60ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converting VIF {"id": "457692b8-151c-4048-9fb4-1ff0f6566699", "address": "fa:16:3e:41:64:4a", "network": {"id": "d96cb26b-ed90-469d-b60c-0d27bc5614a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1801688442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c2820770744df88c94474a2ad02e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457692b8-15", "ovs_interfaceid": "457692b8-151c-4048-9fb4-1ff0f6566699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG os_vif [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457692b8-15, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:30:22 user nova-compute[72441]: INFO os_vif [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:64:4a,bridge_name='br-int',has_traffic_filtering=True,id=457692b8-151c-4048-9fb4-1ff0f6566699,network=Network(d96cb26b-ed90-469d-b60c-0d27bc5614a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457692b8-15')
Aug 09 19:30:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Deleting instance files /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea_del
Aug 09 19:30:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Deletion of /opt/stack/data/nova/instances/2ee4681e-d00f-47af-8b44-e4f8986b60ea_del complete
Aug 09 19:30:22 user nova-compute[72441]: INFO nova.compute.manager [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 19:30:22 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:30:22 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:23 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Took 0.77 seconds to deallocate network for instance.
Aug 09 19:30:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-f006258a-a379-4aac-b1ed-e8dc0172141f req-99c478cd-125f-410f-b6c6-4e24b302da01 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-deleted-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:23 user nova-compute[72441]: INFO nova.compute.manager [req-f006258a-a379-4aac-b1ed-e8dc0172141f req-99c478cd-125f-410f-b6c6-4e24b302da01 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Neutron deleted interface 457692b8-151c-4048-9fb4-1ff0f6566699; detaching it from the instance and deleting it from the info cache
Aug 09 19:30:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-f006258a-a379-4aac-b1ed-e8dc0172141f req-99c478cd-125f-410f-b6c6-4e24b302da01 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-f006258a-a379-4aac-b1ed-e8dc0172141f req-99c478cd-125f-410f-b6c6-4e24b302da01 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Detach interface failed, port_id=457692b8-151c-4048-9fb4-1ff0f6566699, reason: Instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:30:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:23 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Deleted allocations for instance 2ee4681e-d00f-47af-8b44-e4f8986b60ea
Aug 09 19:30:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5fa3194b-d2ce-4ae6-9442-42bd7448f472 tempest-TestMinimumBasicScenario-2005926422 tempest-TestMinimumBasicScenario-2005926422-project-member] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.380s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-dfe04a26-3ddb-4e42-8b16-63bc7dd2561c req-4d3956ed-eb38-40aa-9068-807508047f88 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dfe04a26-3ddb-4e42-8b16-63bc7dd2561c req-4d3956ed-eb38-40aa-9068-807508047f88 service nova] Acquiring lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dfe04a26-3ddb-4e42-8b16-63bc7dd2561c req-4d3956ed-eb38-40aa-9068-807508047f88 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dfe04a26-3ddb-4e42-8b16-63bc7dd2561c req-4d3956ed-eb38-40aa-9068-807508047f88 service nova] Lock "2ee4681e-d00f-47af-8b44-e4f8986b60ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-dfe04a26-3ddb-4e42-8b16-63bc7dd2561c req-4d3956ed-eb38-40aa-9068-807508047f88 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] No waiting events found dispatching network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:24 user nova-compute[72441]: WARNING nova.compute.manager [req-dfe04a26-3ddb-4e42-8b16-63bc7dd2561c req-4d3956ed-eb38-40aa-9068-807508047f88 service nova] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Received unexpected event network-vif-plugged-457692b8-151c-4048-9fb4-1ff0f6566699 for instance with vm_state deleted and task_state None.
Aug 09 19:30:24 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609409.3327777, 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:30:24 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] VM Stopped (Lifecycle Event)
Aug 09 19:30:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d387cf80-2a5b-42fd-9150-af2270262415 None None] [instance: 33aae2c3-6a1f-4c6d-bd1d-fc8ec0143b3c] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:30:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:30:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:30:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:31 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:30:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:36 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:30:36 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6932MB free_disk=24.95974349975586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance a4dd294f-e0ff-41f7-a717-1b383d10b00e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:30:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:37 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609422.2219803, 2ee4681e-d00f-47af-8b44-e4f8986b60ea => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:30:37 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] VM Stopped (Lifecycle Event)
Aug 09 19:30:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5ff6a32e-ca97-48a0-9874-1602d33cfe91 None None] [instance: 2ee4681e-d00f-47af-8b44-e4f8986b60ea] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:30:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:30:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:50 user nova-compute[72441]: INFO nova.compute.manager [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Rescuing
Aug 09 19:30:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:30:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:30:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:30:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updating instance_info_cache with network_info: [{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:30:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:30:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-181d507e-c2a8-4868-8128-7246a7988d8f req-fb121d3e-227c-4f3d-8fc6-c3951503b250 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181d507e-c2a8-4868-8128-7246a7988d8f req-fb121d3e-227c-4f3d-8fc6-c3951503b250 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181d507e-c2a8-4868-8128-7246a7988d8f req-fb121d3e-227c-4f3d-8fc6-c3951503b250 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181d507e-c2a8-4868-8128-7246a7988d8f req-fb121d3e-227c-4f3d-8fc6-c3951503b250 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-181d507e-c2a8-4868-8128-7246a7988d8f req-fb121d3e-227c-4f3d-8fc6-c3951503b250 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:51 user nova-compute[72441]: WARNING nova.compute.manager [req-181d507e-c2a8-4868-8128-7246a7988d8f req-fb121d3e-227c-4f3d-8fc6-c3951503b250 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state active and task_state rescuing.
Aug 09 19:30:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance destroyed successfully.
Aug 09 19:30:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Attempting a stable device rescue
Aug 09 19:30:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:30:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Creating image(s)
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "/opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "1c9aa20e0b10c2e1f8e485d788f14782a865dce9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "1c9aa20e0b10c2e1f8e485d788f14782a865dce9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.part --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:52 user nova-compute[72441]: DEBUG nova.virt.images [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] 09de778d-d247-4534-8bc9-8244ee3d3d69 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:30:52 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:30:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.part /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-7c79a466-9632-45fa-909e-4c217cfc7b09 req-4dfa37f3-8f39-4e7e-a095-bfa25cfd52a5 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7c79a466-9632-45fa-909e-4c217cfc7b09 req-4dfa37f3-8f39-4e7e-a095-bfa25cfd52a5 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7c79a466-9632-45fa-909e-4c217cfc7b09 req-4dfa37f3-8f39-4e7e-a095-bfa25cfd52a5 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7c79a466-9632-45fa-909e-4c217cfc7b09 req-4dfa37f3-8f39-4e7e-a095-bfa25cfd52a5 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-7c79a466-9632-45fa-909e-4c217cfc7b09 req-4dfa37f3-8f39-4e7e-a095-bfa25cfd52a5 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:53 user nova-compute[72441]: WARNING nova.compute.manager [req-7c79a466-9632-45fa-909e-4c217cfc7b09 req-4dfa37f3-8f39-4e7e-a095-bfa25cfd52a5 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state active and task_state rescuing.
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.part /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.converted" returned: 0 in 0.555s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "1c9aa20e0b10c2e1f8e485d788f14782a865dce9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "1c9aa20e0b10c2e1f8e485d788f14782a865dce9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "1c9aa20e0b10c2e1f8e485d788f14782a865dce9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9 --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9,backing_fmt=raw /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9,backing_fmt=raw /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue" returned: 0 in 0.054s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "1c9aa20e0b10c2e1f8e485d788f14782a865dce9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'migration_context' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Start _get_guest_xml network_info=[{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "vif_mac": "fa:16:3e:6c:50:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09de778d-d247-4534-8bc9-8244ee3d3d69', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a4dd294f-e0ff-41f7-a717-1b383d10b00e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd370af45-3cdf-460c-9bdb-087b5cb54a5d', 'serial': 'd370af45-3cdf-460c-9bdb-087b5cb54a5d'}, 'attachment_id': '27439968-2289-428a-b2f0-ae20474d99b9', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'resources' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'numa_topology' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:53 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:30:53 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:30:53 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:30:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:30:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:30:54 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ab6e54-c14c-49eb-899a-599cc95e04d6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lRZUywHO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 19:30:54 user nova-compute[72441]: node.name = iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d
Aug 09 19:30:54 user nova-compute[72441]: node.tpgt = -1
Aug 09 19:30:54 user nova-compute[72441]: node.startup = automatic
Aug 09 19:30:54 user nova-compute[72441]: node.leading_login = No
Aug 09 19:30:54 user nova-compute[72441]: iface.iscsi_ifacename = default
Aug 09 19:30:54 user nova-compute[72441]: iface.net_ifacename = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.ipaddress = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.prefix_len = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.hwaddress = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.transport_name = tcp
Aug 09 19:30:54 user nova-compute[72441]: iface.initiatorname = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.vlan_id = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.vlan_priority = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.vlan_state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.iface_num = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.mtu = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.port = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.bootproto = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.subnet_mask = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.gateway = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_alt_client_id = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_dns = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_learn_iqn = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_vendor_id_state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_vendor_id = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.dhcp_slp_da = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.fragmentation = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.gratuitous_arp = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.incoming_forwarding = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.tos_state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.tos = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.ttl = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.delayed_ack = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.tcp_nagle = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.tcp_wsf_state = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.tcp_wsf = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.tcp_timer_scale = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.tcp_timestamp = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.redirect = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.def_task_mgmt_timeout = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.header_digest = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.data_digest = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.immediate_data = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.initial_r2t = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.data_seq_inorder = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.data_pdu_inorder = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.erl = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.max_receive_data_len = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.first_burst_len = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.max_outstanding_r2t = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.max_burst_len = 0
Aug 09 19:30:54 user nova-compute[72441]: iface.chap_auth = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.bidi_chap = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.strict_login_compliance = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.discovery_auth = <empty>
Aug 09 19:30:54 user nova-compute[72441]: iface.discovery_logout = <empty>
Aug 09 19:30:54 user nova-compute[72441]: node.discovery_address = <empty>
Aug 09 19:30:54 user nova-compute[72441]: node.discovery_port = 0
Aug 09 19:30:54 user nova-compute[72441]: node.discovery_type = static
Aug 09 19:30:54 user nova-compute[72441]: node.session.initial_cmdsn = 0
Aug 09 19:30:54 user nova-compute[72441]: node.session.initial_login_retry_max = 8
Aug 09 19:30:54 user nova-compute[72441]: node.session.xmit_thread_priority = -20
Aug 09 19:30:54 user nova-compute[72441]: node.session.cmds_max = 128
Aug 09 19:30:54 user nova-compute[72441]: node.session.queue_depth = 32
Aug 09 19:30:54 user nova-compute[72441]: node.session.nr_sessions = 1
Aug 09 19:30:54 user nova-compute[72441]: node.session.auth.authmethod = CHAP
Aug 09 19:30:54 user nova-compute[72441]: node.session.auth.username = lRZUywHO
Aug 09 19:30:54 user nova-compute[72441]: node.session.auth.password = ***
Aug 09 19:30:54 user nova-compute[72441]: node.session.auth.username_in = <empty>
Aug 09 19:30:54 user nova-compute[72441]: node.session.auth.password_in = <empty>
Aug 09 19:30:54 user nova-compute[72441]: node.session.auth.chap_algs = MD5
Aug 09 19:30:54 user nova-compute[72441]: node.session.timeo.replacement_timeout = 120
Aug 09 19:30:54 user nova-compute[72441]: node.session.err_timeo.abort_timeout = 15
Aug 09 19:30:54 user nova-compute[72441]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 19:30:54 user nova-compute[72441]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 19:30:54 user nova-compute[72441]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.FastAbort = Yes
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.InitialR2T = No
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.ImmediateData = Yes
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.MaxConnections = 1
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 19:30:54 user nova-compute[72441]: node.session.iscsi.ERL = 0
Aug 09 19:30:54 user nova-compute[72441]: node.session.scan = manual
Aug 09 19:30:54 user nova-compute[72441]: node.session.reopen_max = 0
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].address = 172.16.0.220
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].port = 3260
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].startup = manual
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].tcp.window_size = 524288
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].tcp.type_of_service = 0
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].timeo.logout_timeout = 15
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].timeo.login_timeout = 15
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].timeo.auth_timeout = 45
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].iscsi.DataDigest = None
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].iscsi.IFMarker = No
Aug 09 19:30:54 user nova-compute[72441]: node.conn[0].iscsi.OFMarker = No
Aug 09 19:30:54 user nova-compute[72441]: # END RECORD
Aug 09 19:30:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[25adc493-5eaf-4092-b77e-040bfe617483]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d19a1b-6b7c-4116-b089-77eb638ac789]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRZUywHO {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lRZUywHO" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58edea6-5d19-4cee-b3a8-74f049610b5f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lRZUywHO'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3721f4-6f05-4aab-bdb8-2ddd081e0d44]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d812166e-0c58-420b-a40a-422601e4c1fe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:54 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:54 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:30:54 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:30:54 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:30:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] HCTL ('33', '0', '0', 0) found on session 35 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b5e77-353f-4cbd-be53-1d17ea263c26]: (4, ('0 0 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Searching for a device in session 35 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '26664326165353362', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664326165353362', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2002161486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2002161486',id=32,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:29:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-yl09rnos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:29:38Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=a4dd294f-e0ff-41f7-a717-1b383d10b00e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "vif_mac": "fa:16:3e:6c:50:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "vif_mac": "fa:16:3e:6c:50:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'pci_devices' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:30:54 user nova-compute[72441]:   <uuid>a4dd294f-e0ff-41f7-a717-1b383d10b00e</uuid>
Aug 09 19:30:54 user nova-compute[72441]:   <name>instance-00000020</name>
Aug 09 19:30:54 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:30:54 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:30:54 user nova-compute[72441]:   <metadata>
Aug 09 19:30:54 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:30:54 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:30:54 user nova-compute[72441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2002161486</nova:name>
Aug 09 19:30:54 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:30:53</nova:creationTime>
Aug 09 19:30:54 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:30:54 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:30:54 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:30:54 user nova-compute[72441]:       <nova:owner>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:user uuid="554ea2267ce94d618fbd7ef211cb7b51">tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member</nova:user>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:project uuid="e0d7a9e68495428292b9417ee4b234ad">tempest-ServerBootFromVolumeStableRescueTest-1993502489</nova:project>
Aug 09 19:30:54 user nova-compute[72441]:       </nova:owner>
Aug 09 19:30:54 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:30:54 user nova-compute[72441]:       <nova:ports>
Aug 09 19:30:54 user nova-compute[72441]:         <nova:port uuid="e1b085d4-02b4-411f-bd06-b5f200ef8540">
Aug 09 19:30:54 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 19:30:54 user nova-compute[72441]:         </nova:port>
Aug 09 19:30:54 user nova-compute[72441]:       </nova:ports>
Aug 09 19:30:54 user nova-compute[72441]:     </nova:instance>
Aug 09 19:30:54 user nova-compute[72441]:   </metadata>
Aug 09 19:30:54 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:30:54 user nova-compute[72441]:     <system>
Aug 09 19:30:54 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:30:54 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:30:54 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:30:54 user nova-compute[72441]:       <entry name="serial">a4dd294f-e0ff-41f7-a717-1b383d10b00e</entry>
Aug 09 19:30:54 user nova-compute[72441]:       <entry name="uuid">a4dd294f-e0ff-41f7-a717-1b383d10b00e</entry>
Aug 09 19:30:54 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:30:54 user nova-compute[72441]:     </system>
Aug 09 19:30:54 user nova-compute[72441]:   </sysinfo>
Aug 09 19:30:54 user nova-compute[72441]:   <os>
Aug 09 19:30:54 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:30:54 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:30:54 user nova-compute[72441]:   </os>
Aug 09 19:30:54 user nova-compute[72441]:   <features>
Aug 09 19:30:54 user nova-compute[72441]:     <acpi/>
Aug 09 19:30:54 user nova-compute[72441]:     <apic/>
Aug 09 19:30:54 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:30:54 user nova-compute[72441]:   </features>
Aug 09 19:30:54 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:30:54 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:30:54 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:30:54 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:30:54 user nova-compute[72441]:   </clock>
Aug 09 19:30:54 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:30:54 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:30:54 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:30:54 user nova-compute[72441]:   </cpu>
Aug 09 19:30:54 user nova-compute[72441]:   <devices>
Aug 09 19:30:54 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:30:54 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:30:54 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:30:54 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:30:54 user nova-compute[72441]:       <serial>d370af45-3cdf-460c-9bdb-087b5cb54a5d</serial>
Aug 09 19:30:54 user nova-compute[72441]:     </disk>
Aug 09 19:30:54 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:30:54 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:30:54 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue"/>
Aug 09 19:30:54 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:30:54 user nova-compute[72441]:       <boot order="1"/>
Aug 09 19:30:54 user nova-compute[72441]:     </disk>
Aug 09 19:30:54 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:30:54 user nova-compute[72441]:       <mac address="fa:16:3e:6c:50:7b"/>
Aug 09 19:30:54 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:30:54 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:30:54 user nova-compute[72441]:       <target dev="tape1b085d4-02"/>
Aug 09 19:30:54 user nova-compute[72441]:     </interface>
Aug 09 19:30:54 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:30:54 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/console.log" append="off"/>
Aug 09 19:30:54 user nova-compute[72441]:     </serial>
Aug 09 19:30:54 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:30:54 user nova-compute[72441]:     <video>
Aug 09 19:30:54 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:30:54 user nova-compute[72441]:     </video>
Aug 09 19:30:54 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:30:54 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:30:54 user nova-compute[72441]:     </rng>
Aug 09 19:30:54 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:30:54 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:30:54 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:30:54 user nova-compute[72441]:     </memballoon>
Aug 09 19:30:54 user nova-compute[72441]:   </devices>
Aug 09 19:30:54 user nova-compute[72441]: </domain>
Aug 09 19:30:54 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:30:54 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance destroyed successfully.
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:30:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] No VIF found with MAC fa:16:3e:6c:50:7b, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-52d2df8a-3e5d-4454-a60c-f24facc4709b req-c723affa-e10d-4932-96de-b3ed243354d9 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52d2df8a-3e5d-4454-a60c-f24facc4709b req-c723affa-e10d-4932-96de-b3ed243354d9 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52d2df8a-3e5d-4454-a60c-f24facc4709b req-c723affa-e10d-4932-96de-b3ed243354d9 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52d2df8a-3e5d-4454-a60c-f24facc4709b req-c723affa-e10d-4932-96de-b3ed243354d9 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG nova.compute.manager [req-52d2df8a-3e5d-4454-a60c-f24facc4709b req-c723affa-e10d-4932-96de-b3ed243354d9 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:55 user nova-compute[72441]: WARNING nova.compute.manager [req-52d2df8a-3e5d-4454-a60c-f24facc4709b req-c723affa-e10d-4932-96de-b3ed243354d9 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state active and task_state rescuing.
Aug 09 19:30:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:30:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-ad8a2f0c-b841-4b1f-86b0-7f3e693c8bcf req-dbff7fc6-908e-4e65-8dc8-ffa8181ff454 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ad8a2f0c-b841-4b1f-86b0-7f3e693c8bcf req-dbff7fc6-908e-4e65-8dc8-ffa8181ff454 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:30:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ad8a2f0c-b841-4b1f-86b0-7f3e693c8bcf req-dbff7fc6-908e-4e65-8dc8-ffa8181ff454 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:30:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ad8a2f0c-b841-4b1f-86b0-7f3e693c8bcf req-dbff7fc6-908e-4e65-8dc8-ffa8181ff454 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:30:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-ad8a2f0c-b841-4b1f-86b0-7f3e693c8bcf req-dbff7fc6-908e-4e65-8dc8-ffa8181ff454 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:30:57 user nova-compute[72441]: WARNING nova.compute.manager [req-ad8a2f0c-b841-4b1f-86b0-7f3e693c8bcf req-dbff7fc6-908e-4e65-8dc8-ffa8181ff454 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state active and task_state rescuing.
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for a4dd294f-e0ff-41f7-a717-1b383d10b00e due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609458.1994865, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:30:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Resumed (Lifecycle Event)
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8a006a57-333a-47ff-8957-b846ccc6916c tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:30:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609458.2011719, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:30:58 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Started (Lifecycle Event)
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:30:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:30:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-changed-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:30:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Refreshing instance network info cache due to event network-changed-fee49ffd-b7dc-40a3-9898-f8276e90c46f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:30:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] Acquiring lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:30:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] Acquired lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:30:59 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Refreshing network info cache for port fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updated VIF entry in instance network info cache for port fee49ffd-b7dc-40a3-9898-f8276e90c46f. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updating instance_info_cache with network_info: [{"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9f822660-1b49-4d49-beca-d6238461f070 req-a93a98dd-f56f-4246-ac8d-e37991056dcf service nova] Releasing lock "refresh_cache-b16971a4-7b23-4959-a1f4-fa6dd41607b9" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'flavor' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:00 user nova-compute[72441]: INFO nova.compute.manager [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attaching volume 2e859ef8-8e66-4392-9b7c-87d10938e649 to /dev/vdb
Aug 09 19:31:00 user nova-compute[72441]: DEBUG os_brick.utils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d85c8-1453-40db-83cc-0de13f15f8f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.159s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc225cc-daa0-4470-97db-f8b2c2dd8b0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbdab9d-416a-44a2-9143-a710399e4603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a767ad-685f-4e74-992d-6ce4a5aa7664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:01 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:31:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa284f02-4c78-4b3f-8dc7-37c6826640cc]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG os_brick.utils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] <== get_connector_properties: return (285ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updating existing volume attachment record: 245dd78b-ec80-4743-9a66-97988eeb2cd8 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:31:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:04 user nova-compute[72441]: INFO nova.compute.manager [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Terminating instance
Aug 09 19:31:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-79a9d6cd-8482-4610-b728-25a3a2bae64d req-355410db-2686-43ee-9512-f5a7e0ec9575 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-vif-unplugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-79a9d6cd-8482-4610-b728-25a3a2bae64d req-355410db-2686-43ee-9512-f5a7e0ec9575 service nova] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-79a9d6cd-8482-4610-b728-25a3a2bae64d req-355410db-2686-43ee-9512-f5a7e0ec9575 service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-79a9d6cd-8482-4610-b728-25a3a2bae64d req-355410db-2686-43ee-9512-f5a7e0ec9575 service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-79a9d6cd-8482-4610-b728-25a3a2bae64d req-355410db-2686-43ee-9512-f5a7e0ec9575 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] No waiting events found dispatching network-vif-unplugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:04 user nova-compute[72441]: DEBUG nova.compute.manager [req-79a9d6cd-8482-4610-b728-25a3a2bae64d req-355410db-2686-43ee-9512-f5a7e0ec9575 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-vif-unplugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Instance destroyed successfully.
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.objects.instance [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lazy-loading 'resources' on Instance uuid 2b3a4c39-be92-42c6-86ec-8fcb5447b577 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-488126171',display_name='tempest-AttachVolumeNegativeTest-server-488126171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-488126171',id=30,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6cRALvVztVtI+jowNzS4IPxjaHM4iYSH7955OZ+XbnQhOfLFXZi1BBQV84le32EZCUfr4FBZt1sOytERj9rThNYzJ5sd2AWzf/SE3FKXFuh/mGh4GSRBwWGMxu0OQOjA==',key_name='tempest-keypair-749717868',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:28:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae6d33400f3444387a69b9fc79e4b75',ramdisk_id='',reservation_id='r-3v1zlway',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2037425419',owner_user_name='tempest-AttachVolumeNegativeTest-2037425419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:28:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30843aacab5b4db3b76b43cf978bc721',uuid=2b3a4c39-be92-42c6-86ec-8fcb5447b577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converting VIF {"id": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "address": "fa:16:3e:fa:fc:e4", "network": {"id": "2e6ba3f4-c243-452f-8ceb-5374e6bcde7c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-41334124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae6d33400f3444387a69b9fc79e4b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79ca90-07", "ovs_interfaceid": "2f79ca90-0705-4b5f-a9e1-39b74bc865f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG os_vif [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f79ca90-07, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:31:05 user nova-compute[72441]: INFO os_vif [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:fc:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f79ca90-0705-4b5f-a9e1-39b74bc865f1,network=Network(2e6ba3f4-c243-452f-8ceb-5374e6bcde7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79ca90-07')
Aug 09 19:31:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Deleting instance files /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577_del
Aug 09 19:31:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Deletion of /opt/stack/data/nova/instances/2b3a4c39-be92-42c6-86ec-8fcb5447b577_del complete
Aug 09 19:31:05 user nova-compute[72441]: INFO nova.compute.manager [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'flavor' on Instance uuid 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:05 user nova-compute[72441]: INFO nova.compute.manager [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Attaching volume 0a515e8b-0a64-432e-924b-4db7d83ab4aa to /dev/vdb
Aug 09 19:31:05 user nova-compute[72441]: DEBUG os_brick.utils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8cb5db-de48-4ccd-a1bf-040e406af1d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[606703ed-8865-49bc-93d6-b5f26b5e59a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf9541-3986-47d8-82db-159658e295e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b399683a-3904-4b68-b2f8-07ed6542d50b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:06 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:31:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf376e-f7fa-4cc6-bcfd-591fd22da2d8]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG os_brick.utils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating existing volume attachment record: 18181bc3-cb13-4f41-ba4a-bc15f55ebd4f {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:31:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-changed-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Refreshing instance network info cache due to event network-changed-5ed3ea7c-cbca-4005-a604-0e328b81513f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] Acquiring lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] Acquired lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Refreshing network info cache for port 5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:07 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Took 2.12 seconds to deallocate network for instance.
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-efd9fd28-fe9d-4e98-94fa-f618325f5401 req-30e41172-912c-4a87-875c-7ecd79161b13 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-vif-deleted-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:31:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:07 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Deleted allocations for instance 2b3a4c39-be92-42c6-86ec-8fcb5447b577
Aug 09 19:31:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updated VIF entry in instance network info cache for port 5ed3ea7c-cbca-4005-a604-0e328b81513f. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating instance_info_cache with network_info: [{"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] Releasing lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received event network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] Acquiring lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] No waiting events found dispatching network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:08 user nova-compute[72441]: WARNING nova.compute.manager [req-55f77dce-13d2-40c7-a753-d5b014ac7c92 req-90555334-3f87-4a92-9f9c-22d63ca5ea29 service nova] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Received unexpected event network-vif-plugged-2f79ca90-0705-4b5f-a9e1-39b74bc865f1 for instance with vm_state active and task_state deleting.
Aug 09 19:31:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-dcf04f69-dbb2-4a88-9d3c-407a42749403 tempest-AttachVolumeNegativeTest-2037425419 tempest-AttachVolumeNegativeTest-2037425419-project-member] Lock "2b3a4c39-be92-42c6-86ec-8fcb5447b577" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.857s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltXwEuHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:11 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:11 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:11 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd022554-0445-4134-8c57-0dbb33c51aac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:31:11 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d2c46a-6ad6-4f65-bf29-5bb4628f7cc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649] added
Aug 09 19:31:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbfbe73-3ff0-4961-8dff-b501667b0615]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb12a1f0-d282-4de6-84ca-74d235f11a21]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ltXwEuHg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ltXwEuHg" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5881c209-7197-4d8e-8cd6-962789ca10c3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ltXwEuHg'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61edb1e-cc29-49dd-97df-03d7c0bdd28a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[26641841-e838-4ddf-a6a1-71325d6acabe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a52dcf-6028-41c0-978d-5d7ffc71a191]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260]
Aug 09 19:31:11 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99972eba-917b-4a5e-bf5f-415e05d6dcf9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1cfca6-74b3-4b88-81d3-135ab66fffc6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:11 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f3575-9bb5-47e5-a8b3-740aea31f8a0]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:31:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltXwEuHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:31:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23931363037306538', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931363037306538', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:31:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'flavor' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:31:12 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:12 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:31:12 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:31:12 user nova-compute[72441]:   <serial>2e859ef8-8e66-4392-9b7c-87d10938e649</serial>
Aug 09 19:31:12 user nova-compute[72441]: </disk>
Aug 09 19:31:12 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:31:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No VIF found with MAC fa:16:3e:9e:2d:79, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:31:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c45a5a07-473b-4e3a-a245-ada6fe0cea12 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.558s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfKydAqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:16 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:16 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:16 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9547111-83e5-4dd1-a5ec-d83e2b4ab2c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:31:16 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf9939-fb26-4066-b309-ae9aa0b93a17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa] added
Aug 09 19:31:16 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e6fcb6-41f6-47dc-b4f8-809761c01559]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[392866c8-8613-4a25-98a0-5ae14e54224a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfKydAqb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfKydAqb" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c8c883-dc43-4e9c-bb06-04d0ae75f816]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfKydAqb'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d81180-3543-424b-98b5-dc082d94a6e8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d2662c-d95c-4390-b7b7-baa740ed4dd4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bacf425-6282-45e6-94f0-a2962e430111]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260]
Aug 09 19:31:16 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:16 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5752a9-0455-481e-8060-aa1bfc6facf0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb1f6d2-cda2-42e6-81fb-50e0770ef072]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa (non-flash)
Aug 09 19:31:16 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:16 user nova-compute[72441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa (non-flash)
Aug 09 19:31:16 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc43bd-07eb-4316-b396-1b1fe726a74a]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfKydAqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'flavor' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:17 user nova-compute[72441]: INFO nova.compute.manager [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attaching volume d1d43bfe-8b0b-41db-abfd-1e27a4651cfd to /dev/vdc
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.utils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[348ad55e-12bc-4363-b278-51acbd58caaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ecff89-e976-434d-9169-1e65679178a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce1169-90a4-47c9-a6f1-573e0ef76dfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d55e88b-bfc9-414a-a3ff-9d5eaedad152]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:17 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:31:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05754f8c-9460-4a85-a03a-c66cf55576c4]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.utils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updating existing volume attachment record: 089c4374-ddf1-48cf-98ec-5177f3935307 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23666353961393630', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666353961393630', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'flavor' on Instance uuid 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:31:17 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:17 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:31:17 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:31:17 user nova-compute[72441]:   <serial>0a515e8b-0a64-432e-924b-4db7d83ab4aa</serial>
Aug 09 19:31:17 user nova-compute[72441]: </disk>
Aug 09 19:31:17 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:31:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] No VIF found with MAC fa:16:3e:5d:ea:f3, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:31:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a6ba9c0d-067e-4904-a22b-2f103254323b tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.525s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:20 user nova-compute[72441]: INFO nova.compute.manager [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Detaching volume 0a515e8b-0a64-432e-924b-4db7d83ab4aa
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609465.068642, 2b3a4c39-be92-42c6-86ec-8fcb5447b577 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:20 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] VM Stopped (Lifecycle Event)
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-424989ce-8301-48aa-bcf8-d77d9d116629 None None] [instance: 2b3a4c39-be92-42c6-86ec-8fcb5447b577] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:20 user nova-compute[72441]: INFO nova.virt.block_device [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Attempting to driver detach volume 0a515e8b-0a64-432e-924b-4db7d83ab4aa from mountpoint /dev/vdb
Aug 09 19:31:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Attempting to detach device vdb from instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:31:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:20 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:31:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:31:20 user nova-compute[72441]:   <serial>0a515e8b-0a64-432e-924b-4db7d83ab4aa</serial>
Aug 09 19:31:20 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:31:20 user nova-compute[72441]: </disk>
Aug 09 19:31:20 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:31:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully detached device vdb from instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b from the persistent domain config.
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:31:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:20 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:31:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:31:20 user nova-compute[72441]:   <serial>0a515e8b-0a64-432e-924b-4db7d83ab4aa</serial>
Aug 09 19:31:20 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:31:20 user nova-compute[72441]: </disk>
Aug 09 19:31:20 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609480.5893376, 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:31:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully detached device vdb from instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b from the live domain config.
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfKydAqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:20 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03d0a5-433b-46f2-9038-0447ba9543cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[663323f4-3d5d-4763-9279-9f0c7684628a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa (non-flash)
Aug 09 19:31:20 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:20 user nova-compute[72441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa (non-flash)
Aug 09 19:31:20 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984ff520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2053de64-ac46-43eb-b534-9d3b951f94b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0e8553-836b-4210-a3a8-7e59ea217e65]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d765a-ecdf-4c21-85e0-715c2b7e6ca1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[657e47a3-42ef-4c4a-9b6f-0b8b8bf95abb]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5933e145-e9cc-49f7-a281-072f98215fd1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1109c9-018b-493e-9490-8586da1be7a1]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260]
Aug 09 19:31:20 user nova-compute[72441]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:20 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a515e8b-0a64-432e-924b-4db7d83ab4aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[125418a1-94dd-412d-8ce3-9caa9c125309]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] <== disconnect_volume: return (354ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:31:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'flavor' on Instance uuid 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-628dd876-6932-471b-9c1e-d39a747d96f5 tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.897s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:31:23 user nova-compute[72441]: INFO nova.compute.claims [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Claim successful on node user
Aug 09 19:31:23 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:31:23 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:31:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.policy [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bdbd35f8a0d4f3297acb453e3109176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcefc0bffad468b82ae957092668524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:31:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Creating image(s)
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.165s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk 1073741824" returned: 0 in 0.070s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Cannot resize image /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'migration_context' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Ensure instance console log exists: /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Successfully created port: c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Successfully updated port: c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing instance network info cache due to event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance network_info: |[{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.neutron [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Start _get_guest_xml network_info=[{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:31:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152882460',display_name='tempest-ServerRescueNegativeTestJSON-server-152882460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152882460',id=35,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHiNOr7xUPGpClsjxDVaXRr3F1M5nVTuSVSoSSB8LlY/Btu8dgSl6QeUB8jA8J5sf1Cldb9evi6OA97b9SfAu4lCtRA0nPxbfFRZc/7SaTBJCx7ecA5AbO5/G+WWVyuYA==',key_name='tempest-keypair-1212364424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-9i70dhuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=09347414-6629-463e-a3c5-c1a0a09cde71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'pci_devices' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:31:26 user nova-compute[72441]:   <uuid>09347414-6629-463e-a3c5-c1a0a09cde71</uuid>
Aug 09 19:31:26 user nova-compute[72441]:   <name>instance-00000023</name>
Aug 09 19:31:26 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:31:26 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:31:26 user nova-compute[72441]:   <metadata>
Aug 09 19:31:26 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:31:26 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:31:26 user nova-compute[72441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-152882460</nova:name>
Aug 09 19:31:26 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:31:26</nova:creationTime>
Aug 09 19:31:26 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:31:26 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:31:26 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:31:26 user nova-compute[72441]:       <nova:owner>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:user uuid="3bdbd35f8a0d4f3297acb453e3109176">tempest-ServerRescueNegativeTestJSON-1340711293-project-member</nova:user>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:project uuid="6dcefc0bffad468b82ae957092668524">tempest-ServerRescueNegativeTestJSON-1340711293</nova:project>
Aug 09 19:31:26 user nova-compute[72441]:       </nova:owner>
Aug 09 19:31:26 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:31:26 user nova-compute[72441]:       <nova:ports>
Aug 09 19:31:26 user nova-compute[72441]:         <nova:port uuid="c803b73f-1362-4ea0-93d9-8f380651fd30">
Aug 09 19:31:26 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:31:26 user nova-compute[72441]:         </nova:port>
Aug 09 19:31:26 user nova-compute[72441]:       </nova:ports>
Aug 09 19:31:26 user nova-compute[72441]:     </nova:instance>
Aug 09 19:31:26 user nova-compute[72441]:   </metadata>
Aug 09 19:31:26 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:31:26 user nova-compute[72441]:     <system>
Aug 09 19:31:26 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:31:26 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:31:26 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:31:26 user nova-compute[72441]:       <entry name="serial">09347414-6629-463e-a3c5-c1a0a09cde71</entry>
Aug 09 19:31:26 user nova-compute[72441]:       <entry name="uuid">09347414-6629-463e-a3c5-c1a0a09cde71</entry>
Aug 09 19:31:26 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:31:26 user nova-compute[72441]:     </system>
Aug 09 19:31:26 user nova-compute[72441]:   </sysinfo>
Aug 09 19:31:26 user nova-compute[72441]:   <os>
Aug 09 19:31:26 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:31:26 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:31:26 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:31:26 user nova-compute[72441]:   </os>
Aug 09 19:31:26 user nova-compute[72441]:   <features>
Aug 09 19:31:26 user nova-compute[72441]:     <acpi/>
Aug 09 19:31:26 user nova-compute[72441]:     <apic/>
Aug 09 19:31:26 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:31:26 user nova-compute[72441]:   </features>
Aug 09 19:31:26 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:31:26 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:31:26 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:31:26 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:31:26 user nova-compute[72441]:   </clock>
Aug 09 19:31:26 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:31:26 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:31:26 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:31:26 user nova-compute[72441]:   </cpu>
Aug 09 19:31:26 user nova-compute[72441]:   <devices>
Aug 09 19:31:26 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:31:26 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:31:26 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk"/>
Aug 09 19:31:26 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:31:26 user nova-compute[72441]:     </disk>
Aug 09 19:31:26 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:31:26 user nova-compute[72441]:       <mac address="fa:16:3e:c2:34:f0"/>
Aug 09 19:31:26 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:31:26 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:31:26 user nova-compute[72441]:       <target dev="tapc803b73f-13"/>
Aug 09 19:31:26 user nova-compute[72441]:     </interface>
Aug 09 19:31:26 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:31:26 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/console.log" append="off"/>
Aug 09 19:31:26 user nova-compute[72441]:     </serial>
Aug 09 19:31:26 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:31:26 user nova-compute[72441]:     <video>
Aug 09 19:31:26 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:31:26 user nova-compute[72441]:     </video>
Aug 09 19:31:26 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:31:26 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:31:26 user nova-compute[72441]:     </rng>
Aug 09 19:31:26 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:31:26 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:31:26 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:31:26 user nova-compute[72441]:     </memballoon>
Aug 09 19:31:26 user nova-compute[72441]:   </devices>
Aug 09 19:31:26 user nova-compute[72441]: </domain>
Aug 09 19:31:26 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152882460',display_name='tempest-ServerRescueNegativeTestJSON-server-152882460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152882460',id=35,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHiNOr7xUPGpClsjxDVaXRr3F1M5nVTuSVSoSSB8LlY/Btu8dgSl6QeUB8jA8J5sf1Cldb9evi6OA97b9SfAu4lCtRA0nPxbfFRZc/7SaTBJCx7ecA5AbO5/G+WWVyuYA==',key_name='tempest-keypair-1212364424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-9i70dhuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=09347414-6629-463e-a3c5-c1a0a09cde71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG os_vif [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc803b73f-13, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc803b73f-13, col_values=(('external_ids', {'iface-id': 'c803b73f-1362-4ea0-93d9-8f380651fd30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:34:f0', 'vm-uuid': '09347414-6629-463e-a3c5-c1a0a09cde71'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:26 user nova-compute[72441]: INFO os_vif [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13')
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:c2:34:f0, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiKXqdtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:27 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[315182b9-ca88-410a-9acb-73910b7f9872]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:31:27 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[335de886-b643-43ae-ba86-460d8fcdd1ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd] added
Aug 09 19:31:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe3124-b14a-488f-a763-ab82edd3257b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1915e-f3d7-426d-b0d1-3c4090d7bc67]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiKXqdtc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiKXqdtc" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b08fc-7479-4ad9-802a-914bd0a4b79c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiKXqdtc'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updated VIF entry in instance network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5c198185-b8c5-4076-a122-4264eedd1b34 req-a9cc9f2a-4794-4037-8145-cc643e150082 service nova] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eddb86c-5294-49ac-bb9d-e5c7d0e57754]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b94db5-76a1-43d8-918b-fd54d14fa1d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[136c72c4-6d1a-472f-b704-f83de9d780f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260]
Aug 09 19:31:27 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e49b5-22c8-48fe-93fe-3ac5dfe46672]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34512e67-4db0-4649-8723-37a24fc9e0e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd (non-flash)
Aug 09 19:31:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:27 user nova-compute[72441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd (non-flash)
Aug 09 19:31:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b40e9ea-d53e-468b-bae6-4c382eeb1605]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:31:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiKXqdtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23534303737396263', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534303737396263', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'flavor' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:31:28 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:28 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:31:28 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:31:28 user nova-compute[72441]:   <serial>d1d43bfe-8b0b-41db-abfd-1e27a4651cfd</serial>
Aug 09 19:31:28 user nova-compute[72441]: </disk>
Aug 09 19:31:28 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-ccb78fd9-0330-4e1d-8346-21c2aea6c593 req-87092e8e-a61f-4547-8bdf-4f869fdc14ce service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ccb78fd9-0330-4e1d-8346-21c2aea6c593 req-87092e8e-a61f-4547-8bdf-4f869fdc14ce service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ccb78fd9-0330-4e1d-8346-21c2aea6c593 req-87092e8e-a61f-4547-8bdf-4f869fdc14ce service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ccb78fd9-0330-4e1d-8346-21c2aea6c593 req-87092e8e-a61f-4547-8bdf-4f869fdc14ce service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-ccb78fd9-0330-4e1d-8346-21c2aea6c593 req-87092e8e-a61f-4547-8bdf-4f869fdc14ce service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:28 user nova-compute[72441]: WARNING nova.compute.manager [req-ccb78fd9-0330-4e1d-8346-21c2aea6c593 req-87092e8e-a61f-4547-8bdf-4f869fdc14ce service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state building and task_state spawning.
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] No VIF found with MAC fa:16:3e:9e:2d:79, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1be31e12-2bb8-4851-8bc8-73f6d95cc058 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.082s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:29 user nova-compute[72441]: INFO nova.compute.manager [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Detaching volume d1d43bfe-8b0b-41db-abfd-1e27a4651cfd
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:31:29 user nova-compute[72441]: INFO nova.virt.block_device [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attempting to driver detach volume d1d43bfe-8b0b-41db-abfd-1e27a4651cfd from mountpoint /dev/vdc
Aug 09 19:31:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Attempting to detach device vdc from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:31:29 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:29 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:31:29 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:31:29 user nova-compute[72441]:   <serial>d1d43bfe-8b0b-41db-abfd-1e27a4651cfd</serial>
Aug 09 19:31:29 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 19:31:29 user nova-compute[72441]: </disk>
Aug 09 19:31:29 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:31:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Successfully detached device vdc from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the persistent domain config.
Aug 09 19:31:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:31:29 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:29 user nova-compute[72441]:   <source dev="/dev/sde"/>
Aug 09 19:31:29 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:31:29 user nova-compute[72441]:   <serial>d1d43bfe-8b0b-41db-abfd-1e27a4651cfd</serial>
Aug 09 19:31:29 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 19:31:29 user nova-compute[72441]: </disk>
Aug 09 19:31:29 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:31:29 user nova-compute[72441]: INFO nova.compute.claims [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Claim successful on node user
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609490.183931, b16971a4-7b23-4959-a1f4-fa6dd41607b9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Successfully detached device vdc from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the live domain config.
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiKXqdtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:30 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a70d1b1-edd8-4e1b-b85f-e98f03b88bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdfe155-cd33-491b-a11c-91d212714524]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd (non-flash)
Aug 09 19:31:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:30 user nova-compute[72441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd (non-flash)
Aug 09 19:31:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9835c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b3b30c-9504-4cd5-9817-cb98b86b9044]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9422b-77f2-43ad-b2a7-937d116a41b6]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf6ff4-a7f8-4f97-b373-1b2f70c26df7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5752367e-3690-4ec4-b40d-05817563213e]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd11c13-ece1-413d-9d83-1b02f5110a71]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.policy [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd066b4d22049d0b2129ad1f38ef9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ae81254564eadaf8042330cb1fdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.virt.block_device [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Booting with volume snapshot b61c9073-bb4b-4577-a2a7-6452be507eaf at /dev/vda
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a155323-ccc4-4f2c-8ab1-92fd0f809cce]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260]
Aug 09 19:31:30 user nova-compute[72441]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d43bfe-8b0b-41db-abfd-1e27a4651cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[004198f2-e899-44e8-904e-ea86e49d8ff9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] <== disconnect_volume: return (333ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-064daa50-5c51-455d-a8bd-30a500373c3a req-ebf571e4-a322-4cdb-b21e-da6513dd92af service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-064daa50-5c51-455d-a8bd-30a500373c3a req-ebf571e4-a322-4cdb-b21e-da6513dd92af service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-064daa50-5c51-455d-a8bd-30a500373c3a req-ebf571e4-a322-4cdb-b21e-da6513dd92af service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-064daa50-5c51-455d-a8bd-30a500373c3a req-ebf571e4-a322-4cdb-b21e-da6513dd92af service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-064daa50-5c51-455d-a8bd-30a500373c3a req-ebf571e4-a322-4cdb-b21e-da6513dd92af service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:30 user nova-compute[72441]: WARNING nova.compute.manager [req-064daa50-5c51-455d-a8bd-30a500373c3a req-ebf571e4-a322-4cdb-b21e-da6513dd92af service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state building and task_state spawning.
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609490.8377738, 09347414-6629-463e-a3c5-c1a0a09cde71 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Resumed (Lifecycle Event)
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance spawned successfully.
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609490.837964, 09347414-6629-463e-a3c5-c1a0a09cde71 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Started (Lifecycle Event)
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:31:30 user nova-compute[72441]: INFO nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Took 6.74 seconds to spawn the instance on the hypervisor.
Aug 09 19:31:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Successfully created port: a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:31:31 user nova-compute[72441]: INFO nova.compute.manager [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Took 7.58 seconds to build instance.
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0359ece0-26ca-42a7-bbf2-ce9528ffa3ef tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.706s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'flavor' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78ec7f88-9f77-4a69-b49f-6260e03aeed7 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.847s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:31:31 user nova-compute[72441]: INFO nova.compute.claims [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Claim successful on node user
Aug 09 19:31:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Successfully updated port: a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "refresh_cache-367fad76-d6ba-49c5-8595-6b4a7f05c6a0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquired lock "refresh_cache-367fad76-d6ba-49c5-8595-6b4a7f05c6a0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Updating instance_info_cache with network_info: [{"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Releasing lock "refresh_cache-367fad76-d6ba-49c5-8595-6b4a7f05c6a0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Instance network_info: |[{"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:31:32 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Skipping network cache update for instance because it is Building. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Skipping network cache update for instance because it is Building. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.policy [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f47342db0cd34582b51a1ce8e024e8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985b7412ae7848a9ac95b7f14a2aa4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:31:32 user nova-compute[72441]: INFO nova.virt.block_device [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Booting with volume 49ef235c-5b35-4e62-9301-54435ccdc0dd at /dev/vda
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG os_brick.utils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb47472-98e6-48d2-947c-f6e171a1270f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1058ea70-7c03-4463-b48d-ba2cb47dba68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbced48-16cd-407e-940a-d887b0df6881]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-changed-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Refreshing instance network info cache due to event network-changed-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] Acquiring lock "refresh_cache-367fad76-d6ba-49c5-8595-6b4a7f05c6a0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] Acquired lock "refresh_cache-367fad76-d6ba-49c5-8595-6b4a7f05c6a0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Refreshing network info cache for port a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[da74268a-7e69-46ed-8bdf-a2c774037835]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:32 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:31:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b112e965-264a-4d28-aa83-030693015ecd]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG os_brick.utils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:32 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating existing volume attachment record: 9eee5ca6-2afb-4843-afaf-cd24d9db6f5f {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:31:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Updated VIF entry in instance network info cache for port a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:31:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Updating instance_info_cache with network_info: [{"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0b751000-24b0-4d1d-9f8c-67b9be79b2f5 req-0b443282-a7d1-4d78-a50e-d30bd6cde247 service nova] Releasing lock "refresh_cache-367fad76-d6ba-49c5-8595-6b4a7f05c6a0" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:33 user nova-compute[72441]: DEBUG nova.network.neutron [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Successfully created port: 2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updating instance_info_cache with network_info: [{"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-2ad9a2ce-9bab-4a99-b397-2fb64552efad" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Successfully updated port: 2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquired lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating instance_info_cache with network_info: [{"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Releasing lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance network_info: |[{"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-changed-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Refreshing instance network info cache due to event network-changed-2eeb6e35-7f61-452f-acd1-492a42fb5499. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] Acquiring lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] Acquired lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG nova.network.neutron [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Refreshing network info cache for port 2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updated VIF entry in instance network info cache for port 2eeb6e35-7f61-452f-acd1-492a42fb5499. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating instance_info_cache with network_info: [{"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e89500b3-f349-4ca4-a2eb-14bda5cf4fc8 req-9955b9be-1999-4f79-acd5-23426bf15040 service nova] Releasing lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG os_brick.utils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[38082823-7b1f-49ab-9775-a9634f647e82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd8637f-c210-4cb4-9f4f-cbb9c72e5884]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd6c76-6c40-4756-8f31-3d8f1820d981]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2ce23b-21f7-43ff-ae52-0b7dd8ea03c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:31:36 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f251ed3-6512-4fc6-b9c5-b8ae964cd2ee]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG os_brick.utils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Updating existing volume attachment record: 0ac7a4de-d218-48dd-905e-e9acd0c1111c {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7266MB free_disk=24.916152954101562GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance a4dd294f-e0ff-41f7-a717-1b383d10b00e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:31:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.724s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:31:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:31:42 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Creating image(s)
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Ensure instance console log exists: /opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Start _get_guest_xml network_info=[{"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e84de40-d220-4cd6-8ef3-a04c7231fa16', 'attached_at': '', 'detached_at': '', 'volume_id': '49ef235c-5b35-4e62-9301-54435ccdc0dd', 'serial': '49ef235c-5b35-4e62-9301-54435ccdc0dd'}, 'attachment_id': '9eee5ca6-2afb-4843-afaf-cd24d9db6f5f', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:31:42 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:42 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:42 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:42 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:42 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d03603-60b6-4fe5-aac9-260c06fb4500]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:31:42 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92995ad-b82a-41c7-a0d8-aa6e406a7112]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd] added
Aug 09 19:31:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb7ccc3-8b73-4cbe-8e28-efa08f43c11f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f31b0-8f3e-4800-9c85-86fc16791f44]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OYnErgau {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OYnErgau" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6221279-7c9c-48a2-919a-6b10d1b02724]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OYnErgau'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633e886-cf1b-4d27-a52e-be67a0e42d63]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d335a2-f824-4873-a615-6228a56c54e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:42 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:42 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:42 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:42 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:42 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:42 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d62ea8-8ec8-4696-9fe7-afe13ae275b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]
Aug 09 19:31:43 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6bd17-68bd-4111-912f-f6956eee56e2]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a52a510-e20a-4966-b7ec-5282e92514c8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:31:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:43 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:31:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e3399-3cb4-43ca-bd11-7f90552e57ba]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:31:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23562366333313961', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562366333313961', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-126806307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126806307',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn6IYeMd96nC/HkLCWeqjt3nj9VxcvE5MKXvpO83n23Xk5XmyKKsUNIHpCpNfVuuwcZxyTcLjQF4qk3j7RY9tOO7Zsa5OSPOcGTl72Q90ZYkpWi/v+v56ekPIandwKlqw==',key_name='tempest-keypair-506233433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='985b7412ae7848a9ac95b7f14a2aa4da',ramdisk_id='',reservation_id='r-10rftg7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-264129131',owner_user_name='tempest-ServerActionsV293TestJSON-264129131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47342db0cd34582b51a1ce8e024e8a8',uuid=3e84de40-d220-4cd6-8ef3-a04c7231fa16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converting VIF {"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:31:44 user nova-compute[72441]:   <uuid>3e84de40-d220-4cd6-8ef3-a04c7231fa16</uuid>
Aug 09 19:31:44 user nova-compute[72441]:   <name>instance-00000025</name>
Aug 09 19:31:44 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:31:44 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:31:44 user nova-compute[72441]:   <metadata>
Aug 09 19:31:44 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:31:44 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:31:44 user nova-compute[72441]:       <nova:name>tempest-ServerActionsV293TestJSON-server-126806307</nova:name>
Aug 09 19:31:44 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:31:42</nova:creationTime>
Aug 09 19:31:44 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:31:44 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:31:44 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:31:44 user nova-compute[72441]:       <nova:owner>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:user uuid="f47342db0cd34582b51a1ce8e024e8a8">tempest-ServerActionsV293TestJSON-264129131-project-member</nova:user>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:project uuid="985b7412ae7848a9ac95b7f14a2aa4da">tempest-ServerActionsV293TestJSON-264129131</nova:project>
Aug 09 19:31:44 user nova-compute[72441]:       </nova:owner>
Aug 09 19:31:44 user nova-compute[72441]:       <nova:ports>
Aug 09 19:31:44 user nova-compute[72441]:         <nova:port uuid="2eeb6e35-7f61-452f-acd1-492a42fb5499">
Aug 09 19:31:44 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:31:44 user nova-compute[72441]:         </nova:port>
Aug 09 19:31:44 user nova-compute[72441]:       </nova:ports>
Aug 09 19:31:44 user nova-compute[72441]:     </nova:instance>
Aug 09 19:31:44 user nova-compute[72441]:   </metadata>
Aug 09 19:31:44 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:31:44 user nova-compute[72441]:     <system>
Aug 09 19:31:44 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:31:44 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:31:44 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:31:44 user nova-compute[72441]:       <entry name="serial">3e84de40-d220-4cd6-8ef3-a04c7231fa16</entry>
Aug 09 19:31:44 user nova-compute[72441]:       <entry name="uuid">3e84de40-d220-4cd6-8ef3-a04c7231fa16</entry>
Aug 09 19:31:44 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:31:44 user nova-compute[72441]:     </system>
Aug 09 19:31:44 user nova-compute[72441]:   </sysinfo>
Aug 09 19:31:44 user nova-compute[72441]:   <os>
Aug 09 19:31:44 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:31:44 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:31:44 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:31:44 user nova-compute[72441]:   </os>
Aug 09 19:31:44 user nova-compute[72441]:   <features>
Aug 09 19:31:44 user nova-compute[72441]:     <acpi/>
Aug 09 19:31:44 user nova-compute[72441]:     <apic/>
Aug 09 19:31:44 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:31:44 user nova-compute[72441]:   </features>
Aug 09 19:31:44 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:31:44 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:31:44 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:31:44 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:31:44 user nova-compute[72441]:   </clock>
Aug 09 19:31:44 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:31:44 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:31:44 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:31:44 user nova-compute[72441]:   </cpu>
Aug 09 19:31:44 user nova-compute[72441]:   <devices>
Aug 09 19:31:44 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:31:44 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:44 user nova-compute[72441]:       <source dev="/dev/sde"/>
Aug 09 19:31:44 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:31:44 user nova-compute[72441]:       <serial>49ef235c-5b35-4e62-9301-54435ccdc0dd</serial>
Aug 09 19:31:44 user nova-compute[72441]:     </disk>
Aug 09 19:31:44 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:31:44 user nova-compute[72441]:       <mac address="fa:16:3e:df:6a:c2"/>
Aug 09 19:31:44 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:31:44 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:31:44 user nova-compute[72441]:       <target dev="tap2eeb6e35-7f"/>
Aug 09 19:31:44 user nova-compute[72441]:     </interface>
Aug 09 19:31:44 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:31:44 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16/console.log" append="off"/>
Aug 09 19:31:44 user nova-compute[72441]:     </serial>
Aug 09 19:31:44 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:31:44 user nova-compute[72441]:     <video>
Aug 09 19:31:44 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:31:44 user nova-compute[72441]:     </video>
Aug 09 19:31:44 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:31:44 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:31:44 user nova-compute[72441]:     </rng>
Aug 09 19:31:44 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:31:44 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:31:44 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:31:44 user nova-compute[72441]:     </memballoon>
Aug 09 19:31:44 user nova-compute[72441]:   </devices>
Aug 09 19:31:44 user nova-compute[72441]: </domain>
Aug 09 19:31:44 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-126806307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126806307',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn6IYeMd96nC/HkLCWeqjt3nj9VxcvE5MKXvpO83n23Xk5XmyKKsUNIHpCpNfVuuwcZxyTcLjQF4qk3j7RY9tOO7Zsa5OSPOcGTl72Q90ZYkpWi/v+v56ekPIandwKlqw==',key_name='tempest-keypair-506233433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='985b7412ae7848a9ac95b7f14a2aa4da',ramdisk_id='',reservation_id='r-10rftg7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-264129131',owner_user_name='tempest-ServerActionsV293TestJSON-264129131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47342db0cd34582b51a1ce8e024e8a8',uuid=3e84de40-d220-4cd6-8ef3-a04c7231fa16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converting VIF {"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG os_vif [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eeb6e35-7f, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eeb6e35-7f, col_values=(('external_ids', {'iface-id': '2eeb6e35-7f61-452f-acd1-492a42fb5499', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:6a:c2', 'vm-uuid': '3e84de40-d220-4cd6-8ef3-a04c7231fa16'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:44 user nova-compute[72441]: INFO os_vif [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f')
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] No VIF found with MAC fa:16:3e:df:6a:c2, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-de5797bf-edaf-429b-9c29-c90772c33e1f req-6905ec6f-cb47-4e8c-b2de-7714a5c6cfab service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de5797bf-edaf-429b-9c29-c90772c33e1f req-6905ec6f-cb47-4e8c-b2de-7714a5c6cfab service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de5797bf-edaf-429b-9c29-c90772c33e1f req-6905ec6f-cb47-4e8c-b2de-7714a5c6cfab service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de5797bf-edaf-429b-9c29-c90772c33e1f req-6905ec6f-cb47-4e8c-b2de-7714a5c6cfab service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:45 user nova-compute[72441]: DEBUG nova.compute.manager [req-de5797bf-edaf-429b-9c29-c90772c33e1f req-6905ec6f-cb47-4e8c-b2de-7714a5c6cfab service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:45 user nova-compute[72441]: WARNING nova.compute.manager [req-de5797bf-edaf-429b-9c29-c90772c33e1f req-6905ec6f-cb47-4e8c-b2de-7714a5c6cfab service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state building and task_state spawning.
Aug 09 19:31:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:31:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Creating image(s)
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Ensure instance console log exists: /opt/stack/data/nova/instances/367fad76-d6ba-49c5-8595-6b4a7f05c6a0/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Start _get_guest_xml network_info=[{"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhNzRtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '367fad76-d6ba-49c5-8595-6b4a7f05c6a0', 'attached_at': '', 'detached_at': '', 'volume_id': '14906d82-dd20-4277-89a5-8854b780281f', 'serial': '14906d82-dd20-4277-89a5-8854b780281f'}, 'attachment_id': '0ac7a4de-d218-48dd-905e-e9acd0c1111c', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:31:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhNzRtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:31:46 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:46 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:31:46 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18826a4-2691-472e-ba6f-92c042877504]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:31:46 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3336cb72-1f2c-4dc4-bae1-e50f0ea06359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f] added
Aug 09 19:31:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9ff3d6-45dd-400a-961b-9d1e359c9933]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8048710-f014-4d07-bdbc-eb1b9d64c784]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnhNzRtS {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnhNzRtS" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bdb9ed-7881-409a-9f2d-edd093746f37]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnhNzRtS'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaa733f-00df-4639-9710-0ff7374df251]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469cadf-826d-421b-b142-05639ed285df]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:31:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:46 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:31:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b2250-7bc7-4e6e-9689-4070fc22e532]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260]
Aug 09 19:31:46 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260] successful.
Aug 09 19:31:46 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac1ae8-b09d-4e66-80ab-89b8648800b4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:31:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0975eef0-1bb8-4768-ab3d-bdd555ccb8db]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:31:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:31:47 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:31:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94ec3c5-212b-4664-a905-64117739a2a6]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhNzRtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609507.7318606, 3e84de40-d220-4cd6-8ef3-a04c7231fa16 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] VM Resumed (Lifecycle Event)
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance spawned successfully.
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609507.733941, 3e84de40-d220-4cd6-8ef3-a04c7231fa16 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] VM Started (Lifecycle Event)
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-eb7ecda7-7ed1-42a4-a9ef-d847a0c958ac req-c6d4fc4a-aa87-490b-8996-dab9d29838eb service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-eb7ecda7-7ed1-42a4-a9ef-d847a0c958ac req-c6d4fc4a-aa87-490b-8996-dab9d29838eb service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-eb7ecda7-7ed1-42a4-a9ef-d847a0c958ac req-c6d4fc4a-aa87-490b-8996-dab9d29838eb service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-eb7ecda7-7ed1-42a4-a9ef-d847a0c958ac req-c6d4fc4a-aa87-490b-8996-dab9d29838eb service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:47 user nova-compute[72441]: DEBUG nova.compute.manager [req-eb7ecda7-7ed1-42a4-a9ef-d847a0c958ac req-c6d4fc4a-aa87-490b-8996-dab9d29838eb service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:47 user nova-compute[72441]: WARNING nova.compute.manager [req-eb7ecda7-7ed1-42a4-a9ef-d847a0c958ac req-c6d4fc4a-aa87-490b-8996-dab9d29838eb service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state building and task_state spawning.
Aug 09 19:31:47 user nova-compute[72441]: INFO nova.compute.manager [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Took 16.16 seconds to build instance.
Aug 09 19:31:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a70feca9-0513-41cb-9559-6e6f003462bd tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.271s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23937616135356565', 'path': '/dev/sdg'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937616135356565', 'path': '/dev/sdg'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-32318199',display_name='tempest-TestVolumeBootPattern-server-32318199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-32318199',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-g83qtyzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:30Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=367fad76-d6ba-49c5-8595-6b4a7f05c6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'pci_devices' on Instance uuid 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:31:48 user nova-compute[72441]:   <uuid>367fad76-d6ba-49c5-8595-6b4a7f05c6a0</uuid>
Aug 09 19:31:48 user nova-compute[72441]:   <name>instance-00000024</name>
Aug 09 19:31:48 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:31:48 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:31:48 user nova-compute[72441]:   <metadata>
Aug 09 19:31:48 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:31:48 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:31:48 user nova-compute[72441]:       <nova:name>tempest-TestVolumeBootPattern-server-32318199</nova:name>
Aug 09 19:31:48 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:31:46</nova:creationTime>
Aug 09 19:31:48 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:31:48 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:31:48 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:31:48 user nova-compute[72441]:       <nova:owner>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:user uuid="0fd066b4d22049d0b2129ad1f38ef9e4">tempest-TestVolumeBootPattern-1486219267-project-member</nova:user>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:project uuid="256ae81254564eadaf8042330cb1fdce">tempest-TestVolumeBootPattern-1486219267</nova:project>
Aug 09 19:31:48 user nova-compute[72441]:       </nova:owner>
Aug 09 19:31:48 user nova-compute[72441]:       <nova:ports>
Aug 09 19:31:48 user nova-compute[72441]:         <nova:port uuid="a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc">
Aug 09 19:31:48 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 19:31:48 user nova-compute[72441]:         </nova:port>
Aug 09 19:31:48 user nova-compute[72441]:       </nova:ports>
Aug 09 19:31:48 user nova-compute[72441]:     </nova:instance>
Aug 09 19:31:48 user nova-compute[72441]:   </metadata>
Aug 09 19:31:48 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:31:48 user nova-compute[72441]:     <system>
Aug 09 19:31:48 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:31:48 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:31:48 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:31:48 user nova-compute[72441]:       <entry name="serial">367fad76-d6ba-49c5-8595-6b4a7f05c6a0</entry>
Aug 09 19:31:48 user nova-compute[72441]:       <entry name="uuid">367fad76-d6ba-49c5-8595-6b4a7f05c6a0</entry>
Aug 09 19:31:48 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:31:48 user nova-compute[72441]:     </system>
Aug 09 19:31:48 user nova-compute[72441]:   </sysinfo>
Aug 09 19:31:48 user nova-compute[72441]:   <os>
Aug 09 19:31:48 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:31:48 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:31:48 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:31:48 user nova-compute[72441]:   </os>
Aug 09 19:31:48 user nova-compute[72441]:   <features>
Aug 09 19:31:48 user nova-compute[72441]:     <acpi/>
Aug 09 19:31:48 user nova-compute[72441]:     <apic/>
Aug 09 19:31:48 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:31:48 user nova-compute[72441]:   </features>
Aug 09 19:31:48 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:31:48 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:31:48 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:31:48 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:31:48 user nova-compute[72441]:   </clock>
Aug 09 19:31:48 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:31:48 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:31:48 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:31:48 user nova-compute[72441]:   </cpu>
Aug 09 19:31:48 user nova-compute[72441]:   <devices>
Aug 09 19:31:48 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:31:48 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:31:48 user nova-compute[72441]:       <source dev="/dev/sdg"/>
Aug 09 19:31:48 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:31:48 user nova-compute[72441]:       <serial>14906d82-dd20-4277-89a5-8854b780281f</serial>
Aug 09 19:31:48 user nova-compute[72441]:     </disk>
Aug 09 19:31:48 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:31:48 user nova-compute[72441]:       <mac address="fa:16:3e:b3:ea:74"/>
Aug 09 19:31:48 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:31:48 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:31:48 user nova-compute[72441]:       <target dev="tapa677b1d2-b2"/>
Aug 09 19:31:48 user nova-compute[72441]:     </interface>
Aug 09 19:31:48 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:31:48 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/367fad76-d6ba-49c5-8595-6b4a7f05c6a0/console.log" append="off"/>
Aug 09 19:31:48 user nova-compute[72441]:     </serial>
Aug 09 19:31:48 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:31:48 user nova-compute[72441]:     <video>
Aug 09 19:31:48 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:31:48 user nova-compute[72441]:     </video>
Aug 09 19:31:48 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:31:48 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:31:48 user nova-compute[72441]:     </rng>
Aug 09 19:31:48 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:31:48 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:31:48 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:31:48 user nova-compute[72441]:     </memballoon>
Aug 09 19:31:48 user nova-compute[72441]:   </devices>
Aug 09 19:31:48 user nova-compute[72441]: </domain>
Aug 09 19:31:48 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-32318199',display_name='tempest-TestVolumeBootPattern-server-32318199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-32318199',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-g83qtyzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:30Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=367fad76-d6ba-49c5-8595-6b4a7f05c6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG os_vif [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa677b1d2-b2, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa677b1d2-b2, col_values=(('external_ids', {'iface-id': 'a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:ea:74', 'vm-uuid': '367fad76-d6ba-49c5-8595-6b4a7f05c6a0'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:48 user nova-compute[72441]: INFO os_vif [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2')
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:31:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No VIF found with MAC fa:16:3e:b3:ea:74, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] No waiting events found dispatching network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:49 user nova-compute[72441]: WARNING nova.compute.manager [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received unexpected event network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc for instance with vm_state building and task_state spawning.
Aug 09 19:31:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] No waiting events found dispatching network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:31:49 user nova-compute[72441]: WARNING nova.compute.manager [req-54e46895-2d37-47a8-bfed-40ec88765d4d req-6e1cbe21-3960-4bf6-b627-30532fd95bb5 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received unexpected event network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc for instance with vm_state building and task_state spawning.
Aug 09 19:31:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609511.9032028, 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] VM Resumed (Lifecycle Event)
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:31:51 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Instance spawned successfully.
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:31:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609511.907337, 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:31:51 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] VM Started (Lifecycle Event)
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:31:52 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:31:52 user nova-compute[72441]: INFO nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 09 19:31:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:31:52 user nova-compute[72441]: INFO nova.compute.manager [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Took 22.38 seconds to build instance.
Aug 09 19:31:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-744ad39f-4dc8-4adf-85fb-8abc2798d459 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.478s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:59 user nova-compute[72441]: INFO nova.compute.manager [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Unshelving
Aug 09 19:31:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'pci_requests' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'numa_topology' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:31:59 user nova-compute[72441]: INFO nova.compute.claims [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Claim successful on node user
Aug 09 19:31:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:31:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:31:59 user nova-compute[72441]: INFO nova.network.neutron [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating port e3a03733-e309-4dbd-bb21-c902f5136858 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 19:32:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:32:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:32:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:32:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing instance network info cache due to event network-changed-e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:32:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] Acquiring lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:32:01 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Creating image(s)
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'trusted_certs' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] Acquired lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Refreshing network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "a15addf03d556fcdc1cf01456a78a4cbc1ee2807" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "a15addf03d556fcdc1cf01456a78a4cbc1ee2807" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.part --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG nova.virt.images [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] d050ee19-dcfe-4564-92ab-754d9c0f32c2 was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.part /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updated VIF entry in instance network info cache for port e3a03733-e309-4dbd-bb21-c902f5136858. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb9b5dfd-7efc-4b15-b0eb-9609154e8e3a req-23e8d538-86ac-47ba-ad0f-d7dd53f29bf7 service nova] Releasing lock "refresh_cache-471adda1-bc0b-42e6-9476-206c9ec9b58f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.part /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.converted" returned: 0 in 0.772s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "a15addf03d556fcdc1cf01456a78a4cbc1ee2807" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.294s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "a15addf03d556fcdc1cf01456a78a4cbc1ee2807" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "a15addf03d556fcdc1cf01456a78a4cbc1ee2807" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807,backing_fmt=raw /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807,backing_fmt=raw /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk 1073741824" returned: 0 in 0.053s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "a15addf03d556fcdc1cf01456a78a4cbc1ee2807" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:03 user nova-compute[72441]: DEBUG nova.objects.instance [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'migration_context' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Rebasing disk image.
Aug 09 19:32:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:04 user nova-compute[72441]: INFO nova.compute.manager [None req-570efcfa-8b5a-41ce-95de-8870848a813c tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Get console output
Aug 09 19:32:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 -F raw /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:04 user nova-compute[72441]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 19:32:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 -F raw /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk" returned: 0 in 3.122s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Ensure instance console log exists: /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Start _get_guest_xml network_info=[{"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='157f3f7bab85bc20a6388f797f184569',container_format='bare',created_at=2023-08-09T19:30:06Z,direct_url=<?>,disk_format='qcow2',id=d050ee19-dcfe-4564-92ab-754d9c0f32c2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-121406836-shelved',owner='5f8e21260bfe4c228b1f97b1dbb7a049',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T19:30:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:32:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:32:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='157f3f7bab85bc20a6388f797f184569',container_format='bare',created_at=2023-08-09T19:30:06Z,direct_url=<?>,disk_format='qcow2',id=d050ee19-dcfe-4564-92ab-754d9c0f32c2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-121406836-shelved',owner='5f8e21260bfe4c228b1f97b1dbb7a049',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T19:30:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'vcpu_model' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-121406836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-121406836',id=31,image_ref='d050ee19-dcfe-4564-92ab-754d9c0f32c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1680402287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-77vjub3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member',shelved_at='2023-08-09T19:30:10.362057',shelved_host='user',shelved_image_id='d050ee19-dcfe-4564-92ab-754d9c0f32c2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=471adda1-bc0b-42e6-9476-206c9ec9b58f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'pci_devices' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:32:07 user nova-compute[72441]:   <uuid>471adda1-bc0b-42e6-9476-206c9ec9b58f</uuid>
Aug 09 19:32:07 user nova-compute[72441]:   <name>instance-0000001f</name>
Aug 09 19:32:07 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:32:07 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:32:07 user nova-compute[72441]:   <metadata>
Aug 09 19:32:07 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:32:07 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:32:07 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-121406836</nova:name>
Aug 09 19:32:07 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:32:07</nova:creationTime>
Aug 09 19:32:07 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:32:07 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:32:07 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:32:07 user nova-compute[72441]:       <nova:owner>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:user uuid="890855d048044ea89e304b9fc38b7600">tempest-AttachVolumeShelveTestJSON-1792449968-project-member</nova:user>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:project uuid="5f8e21260bfe4c228b1f97b1dbb7a049">tempest-AttachVolumeShelveTestJSON-1792449968</nova:project>
Aug 09 19:32:07 user nova-compute[72441]:       </nova:owner>
Aug 09 19:32:07 user nova-compute[72441]:       <nova:root type="image" uuid="d050ee19-dcfe-4564-92ab-754d9c0f32c2"/>
Aug 09 19:32:07 user nova-compute[72441]:       <nova:ports>
Aug 09 19:32:07 user nova-compute[72441]:         <nova:port uuid="e3a03733-e309-4dbd-bb21-c902f5136858">
Aug 09 19:32:07 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 19:32:07 user nova-compute[72441]:         </nova:port>
Aug 09 19:32:07 user nova-compute[72441]:       </nova:ports>
Aug 09 19:32:07 user nova-compute[72441]:     </nova:instance>
Aug 09 19:32:07 user nova-compute[72441]:   </metadata>
Aug 09 19:32:07 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:32:07 user nova-compute[72441]:     <system>
Aug 09 19:32:07 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:32:07 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:32:07 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:32:07 user nova-compute[72441]:       <entry name="serial">471adda1-bc0b-42e6-9476-206c9ec9b58f</entry>
Aug 09 19:32:07 user nova-compute[72441]:       <entry name="uuid">471adda1-bc0b-42e6-9476-206c9ec9b58f</entry>
Aug 09 19:32:07 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:32:07 user nova-compute[72441]:     </system>
Aug 09 19:32:07 user nova-compute[72441]:   </sysinfo>
Aug 09 19:32:07 user nova-compute[72441]:   <os>
Aug 09 19:32:07 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:32:07 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:32:07 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:32:07 user nova-compute[72441]:   </os>
Aug 09 19:32:07 user nova-compute[72441]:   <features>
Aug 09 19:32:07 user nova-compute[72441]:     <acpi/>
Aug 09 19:32:07 user nova-compute[72441]:     <apic/>
Aug 09 19:32:07 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:32:07 user nova-compute[72441]:   </features>
Aug 09 19:32:07 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:32:07 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:32:07 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:32:07 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:32:07 user nova-compute[72441]:   </clock>
Aug 09 19:32:07 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:32:07 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:32:07 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:32:07 user nova-compute[72441]:   </cpu>
Aug 09 19:32:07 user nova-compute[72441]:   <devices>
Aug 09 19:32:07 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:32:07 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:32:07 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk"/>
Aug 09 19:32:07 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:32:07 user nova-compute[72441]:     </disk>
Aug 09 19:32:07 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:32:07 user nova-compute[72441]:       <mac address="fa:16:3e:86:76:98"/>
Aug 09 19:32:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:32:07 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:32:07 user nova-compute[72441]:       <target dev="tape3a03733-e3"/>
Aug 09 19:32:07 user nova-compute[72441]:     </interface>
Aug 09 19:32:07 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:32:07 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/console.log" append="off"/>
Aug 09 19:32:07 user nova-compute[72441]:     </serial>
Aug 09 19:32:07 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:32:07 user nova-compute[72441]:     <video>
Aug 09 19:32:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:32:07 user nova-compute[72441]:     </video>
Aug 09 19:32:07 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:32:07 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:32:07 user nova-compute[72441]:     </rng>
Aug 09 19:32:07 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:32:07 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:32:07 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:32:07 user nova-compute[72441]:     </memballoon>
Aug 09 19:32:07 user nova-compute[72441]:   </devices>
Aug 09 19:32:07 user nova-compute[72441]: </domain>
Aug 09 19:32:07 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-121406836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-121406836',id=31,image_ref='d050ee19-dcfe-4564-92ab-754d9c0f32c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1680402287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-77vjub3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member',shelved_at='2023-08-09T19:30:10.362057',shelved_host='user',shelved_image_id='d050ee19-dcfe-4564-92ab-754d9c0f32c2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=471adda1-bc0b-42e6-9476-206c9ec9b58f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG os_vif [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3a03733-e3, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3a03733-e3, col_values=(('external_ids', {'iface-id': 'e3a03733-e309-4dbd-bb21-c902f5136858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:76:98', 'vm-uuid': '471adda1-bc0b-42e6-9476-206c9ec9b58f'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:07 user nova-compute[72441]: INFO os_vif [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3')
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:32:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] No VIF found with MAC fa:16:3e:86:76:98, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:32:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:08 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-272f2a0a-449e-4dbe-bad4-ced402d0bab3 req-10a0b831-987c-4446-8b20-1c19e2a08eef service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-272f2a0a-449e-4dbe-bad4-ced402d0bab3 req-10a0b831-987c-4446-8b20-1c19e2a08eef service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-272f2a0a-449e-4dbe-bad4-ced402d0bab3 req-10a0b831-987c-4446-8b20-1c19e2a08eef service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-272f2a0a-449e-4dbe-bad4-ced402d0bab3 req-10a0b831-987c-4446-8b20-1c19e2a08eef service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-272f2a0a-449e-4dbe-bad4-ced402d0bab3 req-10a0b831-987c-4446-8b20-1c19e2a08eef service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:09 user nova-compute[72441]: WARNING nova.compute.manager [req-272f2a0a-449e-4dbe-bad4-ced402d0bab3 req-10a0b831-987c-4446-8b20-1c19e2a08eef service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 19:32:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-changed-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Refreshing instance network info cache due to event network-changed-5ed3ea7c-cbca-4005-a604-0e328b81513f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:32:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] Acquiring lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:32:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] Acquired lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:32:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Refreshing network info cache for port 5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-cdd74ca7-5405-42f8-aa4c-313de2e331c2 req-b11127da-c8fd-4fde-ba4f-67f6697e9c0b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cdd74ca7-5405-42f8-aa4c-313de2e331c2 req-b11127da-c8fd-4fde-ba4f-67f6697e9c0b service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cdd74ca7-5405-42f8-aa4c-313de2e331c2 req-b11127da-c8fd-4fde-ba4f-67f6697e9c0b service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cdd74ca7-5405-42f8-aa4c-313de2e331c2 req-b11127da-c8fd-4fde-ba4f-67f6697e9c0b service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-cdd74ca7-5405-42f8-aa4c-313de2e331c2 req-b11127da-c8fd-4fde-ba4f-67f6697e9c0b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:11 user nova-compute[72441]: WARNING nova.compute.manager [req-cdd74ca7-5405-42f8-aa4c-313de2e331c2 req-b11127da-c8fd-4fde-ba4f-67f6697e9c0b service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609531.189356, 471adda1-bc0b-42e6-9476-206c9ec9b58f => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:32:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] VM Resumed (Lifecycle Event)
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance spawned successfully.
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updated VIF entry in instance network info cache for port 5ed3ea7c-cbca-4005-a604-0e328b81513f. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating instance_info_cache with network_info: [{"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9781144-158d-4135-9fc6-0c238539d362 req-4a2082be-572b-432a-ae2f-6abe75a50d76 service nova] Releasing lock "refresh_cache-1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:32:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609531.1907196, 471adda1-bc0b-42e6-9476-206c9ec9b58f => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:32:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] VM Started (Lifecycle Event)
Aug 09 19:32:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:11 user nova-compute[72441]: INFO nova.compute.manager [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Terminating instance
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:32:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:32:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-03d8e89c-25f3-49ab-84b6-debaa10d4edb tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.756s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-e5f2c467-bd2f-4392-90c0-d9cc2e13632f req-c60e1ac7-c611-448b-99cc-3c1bf376c6d7 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-vif-unplugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e5f2c467-bd2f-4392-90c0-d9cc2e13632f req-c60e1ac7-c611-448b-99cc-3c1bf376c6d7 service nova] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e5f2c467-bd2f-4392-90c0-d9cc2e13632f req-c60e1ac7-c611-448b-99cc-3c1bf376c6d7 service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e5f2c467-bd2f-4392-90c0-d9cc2e13632f req-c60e1ac7-c611-448b-99cc-3c1bf376c6d7 service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-e5f2c467-bd2f-4392-90c0-d9cc2e13632f req-c60e1ac7-c611-448b-99cc-3c1bf376c6d7 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] No waiting events found dispatching network-vif-unplugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-e5f2c467-bd2f-4392-90c0-d9cc2e13632f req-c60e1ac7-c611-448b-99cc-3c1bf376c6d7 service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-vif-unplugged-5ed3ea7c-cbca-4005-a604-0e328b81513f for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:32:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Instance destroyed successfully.
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'resources' on Instance uuid 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-84698065',display_name='tempest-TestStampPattern-server-84698065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84698065',id=34,image_ref='7973d683-018e-4cd6-a6e2-9e604f89a0e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrZgsijdle9BxvNJuBPf63kpk37GnI0XlUYU0jMHx4vZWwSi+hR41qeqRkciRtRDBfWnZJN+03hS+rGqu74YCdieaN7fN/ECz92zd+TDLdOM4ym5bqAfpDpTlNUP1DeQ==',key_name='tempest-TestStampPattern-2101327217',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:29:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c95e03143adf4a188effce696ecaf244',ramdisk_id='',reservation_id='r-8xgyzchd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6294a114-45f2-45f4-bfd3-a99fd3c7b61d',image_min_disk='1',image_min_ram='0',image_owner_id='c95e03143adf4a188effce696ecaf244',image_owner_project_name='tempest-TestStampPattern-907520302',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-907520302-project-member',image_user_id='a35ddca8c3c14cd0bde36db805885145',owner_project_name='tempest-TestStampPattern-907520302',owner_user_name='tempest-TestStampPattern-907520302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:29:20Z,user_data=None,user_id='a35ddca8c3c14cd0bde36db805885145',uuid=1c55ec4d-b0b1-4c23-b0aa-5531e169db3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converting VIF {"id": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "address": "fa:16:3e:5d:ea:f3", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed3ea7c-cb", "ovs_interfaceid": "5ed3ea7c-cbca-4005-a604-0e328b81513f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG os_vif [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed3ea7c-cb, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:32:12 user nova-compute[72441]: INFO os_vif [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ea:f3,bridge_name='br-int',has_traffic_filtering=True,id=5ed3ea7c-cbca-4005-a604-0e328b81513f,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed3ea7c-cb')
Aug 09 19:32:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Deleting instance files /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b_del
Aug 09 19:32:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Deletion of /opt/stack/data/nova/instances/1c55ec4d-b0b1-4c23-b0aa-5531e169db3b_del complete
Aug 09 19:32:12 user nova-compute[72441]: INFO nova.compute.manager [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 19:32:12 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-2ab9767e-3d24-4582-bf4e-29cdfe956bb0 req-0a97626e-0727-4b2a-933a-53be9f640ffb service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-vif-deleted-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:12 user nova-compute[72441]: INFO nova.compute.manager [req-2ab9767e-3d24-4582-bf4e-29cdfe956bb0 req-0a97626e-0727-4b2a-933a-53be9f640ffb service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Neutron deleted interface 5ed3ea7c-cbca-4005-a604-0e328b81513f; detaching it from the instance and deleting it from the info cache
Aug 09 19:32:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-2ab9767e-3d24-4582-bf4e-29cdfe956bb0 req-0a97626e-0727-4b2a-933a-53be9f640ffb service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:12 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Took 0.59 seconds to deallocate network for instance.
Aug 09 19:32:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-2ab9767e-3d24-4582-bf4e-29cdfe956bb0 req-0a97626e-0727-4b2a-933a-53be9f640ffb service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Detach interface failed, port_id=5ed3ea7c-cbca-4005-a604-0e328b81513f, reason: Instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:32:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:13 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:32:13 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:32:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:13 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Deleted allocations for instance 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b
Aug 09 19:32:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a26ee1e7-216e-4690-b42b-209c5179176d tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-81aeb82a-2abd-4efe-8b27-0e2767718f4e req-a3dae363-da9d-4927-9d60-4245ea0f208e service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received event network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-81aeb82a-2abd-4efe-8b27-0e2767718f4e req-a3dae363-da9d-4927-9d60-4245ea0f208e service nova] Acquiring lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-81aeb82a-2abd-4efe-8b27-0e2767718f4e req-a3dae363-da9d-4927-9d60-4245ea0f208e service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-81aeb82a-2abd-4efe-8b27-0e2767718f4e req-a3dae363-da9d-4927-9d60-4245ea0f208e service nova] Lock "1c55ec4d-b0b1-4c23-b0aa-5531e169db3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-81aeb82a-2abd-4efe-8b27-0e2767718f4e req-a3dae363-da9d-4927-9d60-4245ea0f208e service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] No waiting events found dispatching network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:14 user nova-compute[72441]: WARNING nova.compute.manager [req-81aeb82a-2abd-4efe-8b27-0e2767718f4e req-a3dae363-da9d-4927-9d60-4245ea0f208e service nova] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Received unexpected event network-vif-plugged-5ed3ea7c-cbca-4005-a604-0e328b81513f for instance with vm_state deleted and task_state None.
Aug 09 19:32:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:20 user nova-compute[72441]: INFO nova.compute.manager [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Detaching volume 2e859ef8-8e66-4392-9b7c-87d10938e649
Aug 09 19:32:20 user nova-compute[72441]: INFO nova.virt.block_device [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Attempting to driver detach volume 2e859ef8-8e66-4392-9b7c-87d10938e649 from mountpoint /dev/vdb
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Attempting to detach device vdb from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:32:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:32:20 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:32:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:32:20 user nova-compute[72441]:   <serial>2e859ef8-8e66-4392-9b7c-87d10938e649</serial>
Aug 09 19:32:20 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:32:20 user nova-compute[72441]: </disk>
Aug 09 19:32:20 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:32:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Successfully detached device vdb from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the persistent domain config.
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:32:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:32:20 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:32:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:32:20 user nova-compute[72441]:   <serial>2e859ef8-8e66-4392-9b7c-87d10938e649</serial>
Aug 09 19:32:20 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:32:20 user nova-compute[72441]: </disk>
Aug 09 19:32:20 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609540.774966, b16971a4-7b23-4959-a1f4-fa6dd41607b9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:32:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Successfully detached device vdb from instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 from the live domain config.
Aug 09 19:32:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltXwEuHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:32:20 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3769c-eb82-40aa-8095-b3bb1d813fc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d21855-fa79-4094-b01d-ca33c16e36d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:32:20 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:32:20 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:32:20 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9843f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf7c87-af19-4428-bbca-3d5bc520cc1d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[83321502-304d-447b-a325-da1c8059b31f]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[287276fd-4a58-40e2-aac2-75a1d30fefad]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aebd9cb-5e30-4b0d-ae1f-28383cb08b40]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:32:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f8fcb8-553a-420c-a266-6bb7f3e760cf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e7a93-0707-4c0d-9d1c-9a64bfaeb5df]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260]
Aug 09 19:32:21 user nova-compute[72441]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649, portal: 172.16.0.220,3260] successful.
Aug 09 19:32:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e859ef8-8e66-4392-9b7c-87d10938e649 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52753296-39bd-4838-bb7a-2911740b82ea]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] <== disconnect_volume: return (346ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'flavor' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-162654f1-ae8c-4a4d-8b7e-f388f10aec19 tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.788s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:27 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609532.2636073, 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:32:27 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] VM Stopped (Lifecycle Event)
Aug 09 19:32:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e0d718cc-edac-48d5-bf52-4092d3391e25 None None] [instance: 1c55ec4d-b0b1-4c23-b0aa-5531e169db3b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:30 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:32:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:32:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:32:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:32:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [{"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-822fd908-82ec-4e6c-bcab-b190213e67e7" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:32:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:32:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=6845MB free_disk=24.851886749267578GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance bb15c890-ce98-4e03-811f-8459d12120f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance a4dd294f-e0ff-41f7-a717-1b383d10b00e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance b16971a4-7b23-4959-a1f4-fa6dd41607b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 471adda1-bc0b-42e6-9476-206c9ec9b58f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:32:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:32:38 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:32:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:32:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:32:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:32:41 user nova-compute[72441]: INFO nova.compute.manager [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Unrescuing
Aug 09 19:32:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:32:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquired lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:32:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:32:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updating instance_info_cache with network_info: [{"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Releasing lock "refresh_cache-a4dd294f-e0ff-41f7-a717-1b383d10b00e" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'flavor' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-2269827d-8770-4196-a7ac-fe7ef7ca0ac5 req-81a32579-eb1c-4dcf-a8ea-e737d9213ac2 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2269827d-8770-4196-a7ac-fe7ef7ca0ac5 req-81a32579-eb1c-4dcf-a8ea-e737d9213ac2 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2269827d-8770-4196-a7ac-fe7ef7ca0ac5 req-81a32579-eb1c-4dcf-a8ea-e737d9213ac2 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2269827d-8770-4196-a7ac-fe7ef7ca0ac5 req-81a32579-eb1c-4dcf-a8ea-e737d9213ac2 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-2269827d-8770-4196-a7ac-fe7ef7ca0ac5 req-81a32579-eb1c-4dcf-a8ea-e737d9213ac2 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:42 user nova-compute[72441]: WARNING nova.compute.manager [req-2269827d-8770-4196-a7ac-fe7ef7ca0ac5 req-81a32579-eb1c-4dcf-a8ea-e737d9213ac2 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:42 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance destroyed successfully.
Aug 09 19:32:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:44 user nova-compute[72441]: WARNING nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:44 user nova-compute[72441]: WARNING nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:44 user nova-compute[72441]: WARNING nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:44 user nova-compute[72441]: WARNING nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:44 user nova-compute[72441]: WARNING nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:44 user nova-compute[72441]: WARNING nova.compute.manager [req-19656941-fbce-4695-9ccd-84ae6504567b req-8a52dac0-fb0b-4615-aadf-9a66aa10a825 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:32:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for a4dd294f-e0ff-41f7-a717-1b383d10b00e due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609566.4560373, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:32:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Resumed (Lifecycle Event)
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5bba4314-8f81-4aa2-adac-d4ebd455aac2 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:32:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609566.457455, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:32:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Started (Lifecycle Event)
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-35120ea8-b438-4ed0-9722-5926dd63e46d req-862e630f-9c7f-44bc-8fde-b5af8be1b031 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-35120ea8-b438-4ed0-9722-5926dd63e46d req-862e630f-9c7f-44bc-8fde-b5af8be1b031 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-35120ea8-b438-4ed0-9722-5926dd63e46d req-862e630f-9c7f-44bc-8fde-b5af8be1b031 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-35120ea8-b438-4ed0-9722-5926dd63e46d req-862e630f-9c7f-44bc-8fde-b5af8be1b031 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:32:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-35120ea8-b438-4ed0-9722-5926dd63e46d req-862e630f-9c7f-44bc-8fde-b5af8be1b031 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:32:46 user nova-compute[72441]: WARNING nova.compute.manager [req-35120ea8-b438-4ed0-9722-5926dd63e46d req-862e630f-9c7f-44bc-8fde-b5af8be1b031 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state active and task_state None.
Aug 09 19:32:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:32:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:32:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:32:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:32:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:32:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:33:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:04 user nova-compute[72441]: INFO nova.compute.manager [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Terminating instance
Aug 09 19:33:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:33:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf368afa-a40b-4a15-a985-499debab4ef0 req-b27b0869-969c-499d-a465-1bdbc319edc9 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-unplugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf368afa-a40b-4a15-a985-499debab4ef0 req-b27b0869-969c-499d-a465-1bdbc319edc9 service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf368afa-a40b-4a15-a985-499debab4ef0 req-b27b0869-969c-499d-a465-1bdbc319edc9 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cf368afa-a40b-4a15-a985-499debab4ef0 req-b27b0869-969c-499d-a465-1bdbc319edc9 service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf368afa-a40b-4a15-a985-499debab4ef0 req-b27b0869-969c-499d-a465-1bdbc319edc9 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-unplugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-cf368afa-a40b-4a15-a985-499debab4ef0 req-b27b0869-969c-499d-a465-1bdbc319edc9 service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-unplugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Instance destroyed successfully.
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'resources' on Instance uuid bb15c890-ce98-4e03-811f-8459d12120f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1170996063',display_name='tempest-ServerActionsTestOtherA-server-1170996063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1170996063',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1pusvuyj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=bb15c890-ce98-4e03-811f-8459d12120f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "address": "fa:16:3e:97:5e:be", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f08f9d-d5", "ovs_interfaceid": "90f08f9d-d5d3-474a-a749-1333262e0c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_vif [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90f08f9d-d5, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:33:05 user nova-compute[72441]: INFO os_vif [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=90f08f9d-d5d3-474a-a749-1333262e0c9c,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f08f9d-d5')
Aug 09 19:33:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kWKnCSgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:05 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e379ba-9064-4e60-9af7-38fcaea9478c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e6f2e-9a5b-4bd1-bc9c-6e59ca9c2db2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:33:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:05 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:33:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984fc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28c83f9-18f4-4840-a189-7fbb51a7d8af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be8b288-967e-4f5a-885f-0e3b5ad520f1]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a97ea-cb6e-47f5-a76e-f6640ef61bd3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b81f2-a437-439a-9638-0a1810fe6a5e]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6314c6-4b13-4415-b26c-25578baeab79]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9f9a5-4615-4956-82ab-8b40da035c99]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260]
Aug 09 19:33:05 user nova-compute[72441]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3, portal: 172.16.0.220,3260] successful.
Aug 09 19:33:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96864e-327a-495b-a759-f6952c8a746a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] <== disconnect_volume: return (320ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:33:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Deleting instance files /opt/stack/data/nova/instances/bb15c890-ce98-4e03-811f-8459d12120f8_del
Aug 09 19:33:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Deletion of /opt/stack/data/nova/instances/bb15c890-ce98-4e03-811f-8459d12120f8_del complete
Aug 09 19:33:06 user nova-compute[72441]: INFO nova.compute.manager [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 09 19:33:06 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:07 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Took 1.04 seconds to deallocate network for instance.
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-850e3694-4195-4fec-ac99-c779ba7fe19e req-da9d1a52-8462-4c52-9142-1f1ab8a9714a service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-deleted-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:07 user nova-compute[72441]: INFO nova.compute.manager [req-850e3694-4195-4fec-ac99-c779ba7fe19e req-da9d1a52-8462-4c52-9142-1f1ab8a9714a service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Neutron deleted interface 90f08f9d-d5d3-474a-a749-1333262e0c9c; detaching it from the instance and deleting it from the info cache
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-850e3694-4195-4fec-ac99-c779ba7fe19e req-da9d1a52-8462-4c52-9142-1f1ab8a9714a service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-850e3694-4195-4fec-ac99-c779ba7fe19e req-da9d1a52-8462-4c52-9142-1f1ab8a9714a service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Detach interface failed, port_id=90f08f9d-d5d3-474a-a749-1333262e0c9c, reason: Instance bb15c890-ce98-4e03-811f-8459d12120f8 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-dd93ca18-0ef5-4a8d-bbec-61eeaa16878d req-656cc205-93ff-44cc-9805-284b47124dfe service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dd93ca18-0ef5-4a8d-bbec-61eeaa16878d req-656cc205-93ff-44cc-9805-284b47124dfe service nova] Acquiring lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dd93ca18-0ef5-4a8d-bbec-61eeaa16878d req-656cc205-93ff-44cc-9805-284b47124dfe service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dd93ca18-0ef5-4a8d-bbec-61eeaa16878d req-656cc205-93ff-44cc-9805-284b47124dfe service nova] Lock "bb15c890-ce98-4e03-811f-8459d12120f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-dd93ca18-0ef5-4a8d-bbec-61eeaa16878d req-656cc205-93ff-44cc-9805-284b47124dfe service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] No waiting events found dispatching network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:07 user nova-compute[72441]: WARNING nova.compute.manager [req-dd93ca18-0ef5-4a8d-bbec-61eeaa16878d req-656cc205-93ff-44cc-9805-284b47124dfe service nova] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Received unexpected event network-vif-plugged-90f08f9d-d5d3-474a-a749-1333262e0c9c for instance with vm_state active and task_state deleting.
Aug 09 19:33:07 user nova-compute[72441]: INFO nova.compute.manager [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Took 0.80 seconds to detach 1 volumes for instance.
Aug 09 19:33:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Deleting volume: c9659761-2eaf-4e18-b58d-d8cea9cc6dd3 {{(pid=72441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 19:33:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:33:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:33:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:08 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Deleted allocations for instance bb15c890-ce98-4e03-811f-8459d12120f8
Aug 09 19:33:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3502eff8-7974-49d9-af82-2f111e027ace tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "bb15c890-ce98-4e03-811f-8459d12120f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.949s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:10 user nova-compute[72441]: INFO nova.compute.manager [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Terminating instance
Aug 09 19:33:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-2f1c7be0-d8f9-4e13-a126-3f268571499a req-70089fde-e430-49b7-81ea-ebb1ae172914 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-vif-unplugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2f1c7be0-d8f9-4e13-a126-3f268571499a req-70089fde-e430-49b7-81ea-ebb1ae172914 service nova] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2f1c7be0-d8f9-4e13-a126-3f268571499a req-70089fde-e430-49b7-81ea-ebb1ae172914 service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2f1c7be0-d8f9-4e13-a126-3f268571499a req-70089fde-e430-49b7-81ea-ebb1ae172914 service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-2f1c7be0-d8f9-4e13-a126-3f268571499a req-70089fde-e430-49b7-81ea-ebb1ae172914 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] No waiting events found dispatching network-vif-unplugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-2f1c7be0-d8f9-4e13-a126-3f268571499a req-70089fde-e430-49b7-81ea-ebb1ae172914 service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-vif-unplugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:33:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Instance destroyed successfully.
Aug 09 19:33:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lazy-loading 'resources' on Instance uuid b16971a4-7b23-4959-a1f4-fa6dd41607b9 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-535432846',display_name='tempest-TestServerVolumeAttachmentScenario-server-535432846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-535432846',id=33,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChWK5A81x7ZnRBlV642Zxuv9qCmWkuMBREw1gEbzRx8fZKgyo8qEoZRzE3A/7Dj8VZPh9zs320M5NsgkEddUmhtLcHD+Ne2RhjxEaYovKMdI56FlMrIgkBWFVd29Ihn0A==',key_name='tempest-keypair-1166871200',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf870ac959134304aacf60967046d8c4',ramdisk_id='',reservation_id='r-w5yrwu04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1833202574',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1833202574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d143ff437fe2448f885de68a4e112244',uuid=b16971a4-7b23-4959-a1f4-fa6dd41607b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Converting VIF {"id": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "address": "fa:16:3e:9e:2d:79", "network": {"id": "d8139365-6688-4885-9f4b-e67365dc08ff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592656027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf870ac959134304aacf60967046d8c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee49ffd-b7", "ovs_interfaceid": "fee49ffd-b7dc-40a3-9898-f8276e90c46f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG os_vif [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfee49ffd-b7, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:33:11 user nova-compute[72441]: INFO os_vif [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2d:79,bridge_name='br-int',has_traffic_filtering=True,id=fee49ffd-b7dc-40a3-9898-f8276e90c46f,network=Network(d8139365-6688-4885-9f4b-e67365dc08ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee49ffd-b7')
Aug 09 19:33:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Deleting instance files /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9_del
Aug 09 19:33:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Deletion of /opt/stack/data/nova/instances/b16971a4-7b23-4959-a1f4-fa6dd41607b9_del complete
Aug 09 19:33:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:11 user nova-compute[72441]: INFO nova.compute.manager [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 19:33:11 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:33:11 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:12 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Took 1.06 seconds to deallocate network for instance.
Aug 09 19:33:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-0ff14655-4230-48eb-ae5f-fa099ed13d9e req-c3eddcc4-c8fa-4213-a05f-ad858ecab1de service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-vif-deleted-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-3070aa33-365e-43dd-a256-b497e8eb9ede req-db4bcb19-8026-4dca-bf85-28295bae5e6e service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received event network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3070aa33-365e-43dd-a256-b497e8eb9ede req-db4bcb19-8026-4dca-bf85-28295bae5e6e service nova] Acquiring lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3070aa33-365e-43dd-a256-b497e8eb9ede req-db4bcb19-8026-4dca-bf85-28295bae5e6e service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3070aa33-365e-43dd-a256-b497e8eb9ede req-db4bcb19-8026-4dca-bf85-28295bae5e6e service nova] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-3070aa33-365e-43dd-a256-b497e8eb9ede req-db4bcb19-8026-4dca-bf85-28295bae5e6e service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] No waiting events found dispatching network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:12 user nova-compute[72441]: WARNING nova.compute.manager [req-3070aa33-365e-43dd-a256-b497e8eb9ede req-db4bcb19-8026-4dca-bf85-28295bae5e6e service nova] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Received unexpected event network-vif-plugged-fee49ffd-b7dc-40a3-9898-f8276e90c46f for instance with vm_state deleted and task_state None.
Aug 09 19:33:12 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:33:13 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:33:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:13 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Deleted allocations for instance b16971a4-7b23-4959-a1f4-fa6dd41607b9
Aug 09 19:33:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c8084e-7aa5-4893-ba2d-49b210d96b0c tempest-TestServerVolumeAttachmentScenario-1833202574 tempest-TestServerVolumeAttachmentScenario-1833202574-project-member] Lock "b16971a4-7b23-4959-a1f4-fa6dd41607b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.615s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing instance network info cache due to event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:33:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:33:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:33:14 user nova-compute[72441]: DEBUG nova.network.neutron [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'flavor' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-changed-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Refreshing instance network info cache due to event network-changed-afd05d43-10df-4d08-bdd6-e5994b7b8aa0. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] Acquiring lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] Acquired lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Refreshing network info cache for port afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:15 user nova-compute[72441]: INFO nova.compute.manager [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Terminating instance
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:15 user nova-compute[72441]: INFO nova.compute.manager [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Attaching volume 0607edaa-bdbe-4eda-b613-d4dedaf250fd to /dev/vdb
Aug 09 19:33:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG os_brick.utils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d13d8ee-b331-442c-9c58-994f6d350b30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9784f8-325b-4d0f-9b93-c448f13d29b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0206203-0bb6-4402-9848-fdeccafae976]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1e4e2a-0b9e-43e2-b7eb-d67d6d213d6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:33:15 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[785cd6c4-a552-46ea-a103-b53a95892f52]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG os_brick.utils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating existing volume attachment record: 25f962bb-6984-4cfd-9684-f561120774bf {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updated VIF entry in instance network info cache for port afd05d43-10df-4d08-bdd6-e5994b7b8aa0. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updating instance_info_cache with network_info: [{"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-78c5fc0b-5115-4446-8b9d-af4bf521b80a req-f0c0ce80-7559-41ab-8053-2cd48c4e7e4a service nova] Releasing lock "refresh_cache-6294a114-45f2-45f4-bfd3-a99fd3c7b61d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updated VIF entry in instance network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG nova.network.neutron [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7c967632-3e4b-4696-9f41-83322a49e464 req-ca0b142f-187b-4f2d-b7bb-58447d8443f7 service nova] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:33:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Instance destroyed successfully.
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lazy-loading 'resources' on Instance uuid 6294a114-45f2-45f4-bfd3-a99fd3c7b61d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1270475299',display_name='tempest-TestStampPattern-server-1270475299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1270475299',id=27,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrZgsijdle9BxvNJuBPf63kpk37GnI0XlUYU0jMHx4vZWwSi+hR41qeqRkciRtRDBfWnZJN+03hS+rGqu74YCdieaN7fN/ECz92zd+TDLdOM4ym5bqAfpDpTlNUP1DeQ==',key_name='tempest-TestStampPattern-2101327217',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:26:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c95e03143adf4a188effce696ecaf244',ramdisk_id='',reservation_id='r-dy7b47c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-907520302',owner_user_name='tempest-TestStampPattern-907520302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:29:10Z,user_data=None,user_id='a35ddca8c3c14cd0bde36db805885145',uuid=6294a114-45f2-45f4-bfd3-a99fd3c7b61d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converting VIF {"id": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "address": "fa:16:3e:7e:c0:e1", "network": {"id": "0a68aef8-12e5-43f0-bf30-30971ddbfe8b", "bridge": "br-int", "label": "tempest-TestStampPattern-367913574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95e03143adf4a188effce696ecaf244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd05d43-10", "ovs_interfaceid": "afd05d43-10df-4d08-bdd6-e5994b7b8aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG os_vif [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafd05d43-10, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:16 user nova-compute[72441]: INFO os_vif [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:c0:e1,bridge_name='br-int',has_traffic_filtering=True,id=afd05d43-10df-4d08-bdd6-e5994b7b8aa0,network=Network(0a68aef8-12e5-43f0-bf30-30971ddbfe8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd05d43-10')
Aug 09 19:33:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Deleting instance files /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d_del
Aug 09 19:33:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Deletion of /opt/stack/data/nova/instances/6294a114-45f2-45f4-bfd3-a99fd3c7b61d_del complete
Aug 09 19:33:16 user nova-compute[72441]: INFO nova.compute.manager [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 19:33:16 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:16 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:16 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Took 0.83 seconds to deallocate network for instance.
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-vif-unplugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] No waiting events found dispatching network-vif-unplugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:17 user nova-compute[72441]: WARNING nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received unexpected event network-vif-unplugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 for instance with vm_state deleted and task_state None.
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] Acquiring lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] No waiting events found dispatching network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:17 user nova-compute[72441]: WARNING nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received unexpected event network-vif-plugged-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 for instance with vm_state deleted and task_state None.
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9daea887-2aea-4549-af8e-7368a02e96af req-7b94b278-3bc7-4ce7-a48e-57795f27d26b service nova] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Received event network-vif-deleted-afd05d43-10df-4d08-bdd6-e5994b7b8aa0 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:17 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Deleted allocations for instance 6294a114-45f2-45f4-bfd3-a99fd3c7b61d
Aug 09 19:33:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-53a6266f-3e8e-4d4a-90ea-7c57639b850c tempest-TestStampPattern-907520302 tempest-TestStampPattern-907520302-project-member] Lock "6294a114-45f2-45f4-bfd3-a99fd3c7b61d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:20 user nova-compute[72441]: INFO nova.compute.manager [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Terminating instance
Aug 09 19:33:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609585.6424153, bb15c890-ce98-4e03-811f-8459d12120f8 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:20 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] VM Stopped (Lifecycle Event)
Aug 09 19:33:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f7cf47e3-62ac-4dce-b404-d9ddcd1364fe None None] [instance: bb15c890-ce98-4e03-811f-8459d12120f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-1d4b0e80-a604-4aea-927d-fa43127d90e8 req-f42e8d11-1e99-433a-b0b1-c221e5c67606 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-vif-unplugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1d4b0e80-a604-4aea-927d-fa43127d90e8 req-f42e8d11-1e99-433a-b0b1-c221e5c67606 service nova] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1d4b0e80-a604-4aea-927d-fa43127d90e8 req-f42e8d11-1e99-433a-b0b1-c221e5c67606 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1d4b0e80-a604-4aea-927d-fa43127d90e8 req-f42e8d11-1e99-433a-b0b1-c221e5c67606 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-1d4b0e80-a604-4aea-927d-fa43127d90e8 req-f42e8d11-1e99-433a-b0b1-c221e5c67606 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] No waiting events found dispatching network-vif-unplugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-1d4b0e80-a604-4aea-927d-fa43127d90e8 req-f42e8d11-1e99-433a-b0b1-c221e5c67606 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-vif-unplugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Instance destroyed successfully.
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'resources' on Instance uuid 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-32318199',display_name='tempest-TestVolumeBootPattern-server-32318199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-32318199',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:31:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-g83qtyzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:31:52Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=367fad76-d6ba-49c5-8595-6b4a7f05c6a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "address": "fa:16:3e:b3:ea:74", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa677b1d2-b2", "ovs_interfaceid": "a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_vif [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa677b1d2-b2, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:21 user nova-compute[72441]: INFO os_vif [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ea:74,bridge_name='br-int',has_traffic_filtering=True,id=a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa677b1d2-b2')
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhNzRtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:21 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9991a59-6521-491e-8c75-d145afc225cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed72e38-2fe4-44b4-85ff-3cad4a2a5c1e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:21 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:21 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:21 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:33:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:21 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:21 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:21 user nova-compute[72441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f (non-flash)
Aug 09 19:33:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f'): ({'sdg'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Removing single pathed devices sdg {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffabefbd-6d2e-4b43-91d9-57e20fd14f52]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[404179e4-ab95-41a4-8427-678278d55297]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flushing IO for device /dev/sdg {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60de331-3f2e-4459-a3f3-5ce070ad39f8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705873e-30be-4521-9f87-0f5fde815c25]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] SCSI volumes sdg have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO26994fe1-97aa55ee5339d0ba', '/dev/disk/by-id/scsi-23937616135356565', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_26994fe1') {{(pid=83536) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5991b-ddf7-4d39-a6e6-fc82eae4c113]: (4, None) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2da50-779c-40fe-8d2e-535d0e34d0cc]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a72b65-c5a9-46b1-a020-c7558fcb0d31]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260]
Aug 09 19:33:21 user nova-compute[72441]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f, portal: 172.16.0.220,3260] successful.
Aug 09 19:33:21 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14906d82-dd20-4277-89a5-8854b780281f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74909feb-c63b-4097-9393-97024fca236a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== disconnect_volume: return (317ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:33:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Deleting instance files /opt/stack/data/nova/instances/367fad76-d6ba-49c5-8595-6b4a7f05c6a0_del
Aug 09 19:33:21 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Deletion of /opt/stack/data/nova/instances/367fad76-d6ba-49c5-8595-6b4a7f05c6a0_del complete
Aug 09 19:33:21 user nova-compute[72441]: INFO nova.compute.manager [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 09 19:33:21 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:33:21 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:33:22 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:22 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Took 0.51 seconds to deallocate network for instance.
Aug 09 19:33:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] Acquiring lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] No waiting events found dispatching network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:22 user nova-compute[72441]: WARNING nova.compute.manager [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received unexpected event network-vif-plugged-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc for instance with vm_state active and task_state deleting.
Aug 09 19:33:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-f7ccbcb5-050a-4811-8669-9bbb6abe02d8 req-b18e11c7-6531-4e2e-a3c2-f6a86469b4a3 service nova] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Received event network-vif-deleted-a677b1d2-b2c7-4dc5-b9b3-6be8a1f7d4bc {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:23 user nova-compute[72441]: INFO nova.compute.manager [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Took 0.76 seconds to detach 1 volumes for instance.
Aug 09 19:33:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Deleting volume: 14906d82-dd20-4277-89a5-8854b780281f {{(pid=72441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-changed-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG nova.compute.manager [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Refreshing instance network info cache due to event network-changed-2eeb6e35-7f61-452f-acd1-492a42fb5499. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] Acquiring lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] Acquired lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Refreshing network info cache for port 2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:33:23 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.732s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:24 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Deleted allocations for instance 367fad76-d6ba-49c5-8595-6b4a7f05c6a0
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.network.neutron [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updated VIF entry in instance network info cache for port 2eeb6e35-7f61-452f-acd1-492a42fb5499. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.network.neutron [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating instance_info_cache with network_info: [{"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0ecc9300-adb5-4015-a3c5-3d8af6d1948e tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "367fad76-d6ba-49c5-8595-6b4a7f05c6a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.658s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-03d68935-cc07-4b53-9733-ad8320eb6582 req-f8eb89bd-d378-44d0-992e-e857351aaa70 service nova] Releasing lock "refresh_cache-3e84de40-d220-4cd6-8ef3-a04c7231fa16" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:33:24 user nova-compute[72441]: INFO nova.compute.manager [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Rebuilding instance
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'pci_requests' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'resources' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VufibaZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:24 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:24 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:24 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'migration_context' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72441) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c7b21-cadc-44ec-845d-3dd7c632388e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:33:24 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76eb583-ac24-4b46-b5d5-80672c2ac241]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd] added
Aug 09 19:33:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d946c4-4cce-4396-a12d-6596b930b2ef]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c7e13f-bba8-49e2-b5ce-8b7b78c8532e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VufibaZY {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VufibaZY" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8925c7-0e06-4727-a213-0e64f4bc270d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VufibaZY'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[431815fd-8de5-4909-9c0c-d567c570a4fc]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd43a847-b7c9-4a16-861e-af1488eb0361]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:24 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:24 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:24 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:24 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:24 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:24 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c9fa7-7e2c-40ad-ad28-ccfe5d781272]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260]
Aug 09 19:33:25 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260] successful.
Aug 09 19:33:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-3c2b0cce-0112-4620-8632-3900509684bf req-ce16c249-816c-4096-9480-61c0e42b0066 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-unplugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3c2b0cce-0112-4620-8632-3900509684bf req-ce16c249-816c-4096-9480-61c0e42b0066 service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3c2b0cce-0112-4620-8632-3900509684bf req-ce16c249-816c-4096-9480-61c0e42b0066 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3c2b0cce-0112-4620-8632-3900509684bf req-ce16c249-816c-4096-9480-61c0e42b0066 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-3c2b0cce-0112-4620-8632-3900509684bf req-ce16c249-816c-4096-9480-61c0e42b0066 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-unplugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:25 user nova-compute[72441]: WARNING nova.compute.manager [req-3c2b0cce-0112-4620-8632-3900509684bf req-ce16c249-816c-4096-9480-61c0e42b0066 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-unplugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state active and task_state rebuilding.
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41c7fc7-b310-477b-997d-a8253f5022ef]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cf6425-f0e2-4591-91f6-319298f9545c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:25 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:25 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:25 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:25 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:25 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:25 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[32da0545-ce20-467a-9501-e9372f464be2]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:33:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance destroyed successfully.
Aug 09 19:33:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance destroyed successfully.
Aug 09 19:33:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1036900387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126806307',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn6IYeMd96nC/HkLCWeqjt3nj9VxcvE5MKXvpO83n23Xk5XmyKKsUNIHpCpNfVuuwcZxyTcLjQF4qk3j7RY9tOO7Zsa5OSPOcGTl72Q90ZYkpWi/v+v56ekPIandwKlqw==',key_name='tempest-keypair-506233433',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:31:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='985b7412ae7848a9ac95b7f14a2aa4da',ramdisk_id='',reservation_id='r-10rftg7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-264129131',owner_user_name='tempest-ServerActionsV293TestJSON-264129131-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:33:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47342db0cd34582b51a1ce8e024e8a8',uuid=3e84de40-d220-4cd6-8ef3-a04c7231fa16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converting VIF {"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eeb6e35-7f, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:33:25 user nova-compute[72441]: INFO os_vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f')
Aug 09 19:33:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:25 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:33:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VufibaZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26664303431663439', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664303431663439', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.536s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'flavor' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0ddae-084e-40fc-bd02-7bf14065a78a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:33:26 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:33:26 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:33:26 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:33:26 user nova-compute[72441]:   <serial>0607edaa-bdbe-4eda-b613-d4dedaf250fd</serial>
Aug 09 19:33:26 user nova-compute[72441]: </disk>
Aug 09 19:33:26 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6972e-3035-4e04-9791-73662e5b331f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90610940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c291ee-dc7a-4a95-b40b-2339f5a96246]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f3cf1a-0cb0-4a1e-8dd0-9f7fd0c9ebd3]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[183931b2-9dde-4cfe-a6c5-a3ec1c850069]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01df97b7-8fd0-4185-b8d9-828f6e3596c2]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b685f00a-a14e-4ba4-8a12-03f2072bd369]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609591.3562524, b16971a4-7b23-4959-a1f4-fa6dd41607b9 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:26 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] VM Stopped (Lifecycle Event)
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-21de735f-ee12-4965-8e6f-80d8d113e63b None None] [instance: b16971a4-7b23-4959-a1f4-fa6dd41607b9] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00ca1c-a084-4b4d-b784-e4dfac0ad4dc]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]
Aug 09 19:33:26 user nova-compute[72441]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.
Aug 09 19:33:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f64014-42c2-4a4d-a092-13cdf5a8491e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== disconnect_volume: return (834ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:33:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Deleting instance files /opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16_del
Aug 09 19:33:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Deletion of /opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16_del complete
Aug 09 19:33:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:c2:34:f0, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:33:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16 could not be found.
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:26 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e22041-c2f2-49ca-a613-0d4fb0686b4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcc6f20-4c1d-45c9-83c5-8fc5fdeb1f2a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:26 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd904cbe20>, {}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Disconnecting from: [] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== disconnect_volume: return (51ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:33:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e8c34a08-ced5-43cd-809b-4082f2b4b19e tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.448s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-2cecf990-5b09-4291-a4e0-52c6c56703b3 req-77ce745c-293a-484d-b4d5-c7c07b49da29 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2cecf990-5b09-4291-a4e0-52c6c56703b3 req-77ce745c-293a-484d-b4d5-c7c07b49da29 service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2cecf990-5b09-4291-a4e0-52c6c56703b3 req-77ce745c-293a-484d-b4d5-c7c07b49da29 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2cecf990-5b09-4291-a4e0-52c6c56703b3 req-77ce745c-293a-484d-b4d5-c7c07b49da29 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-2cecf990-5b09-4291-a4e0-52c6c56703b3 req-77ce745c-293a-484d-b4d5-c7c07b49da29 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:27 user nova-compute[72441]: WARNING nova.compute.manager [req-2cecf990-5b09-4291-a4e0-52c6c56703b3 req-77ce745c-293a-484d-b4d5-c7c07b49da29 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state active and task_state rebuilding.
Aug 09 19:33:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Preparing to wait for external event volume-reimaged-49ef235c-5b35-4e62-9301-54435ccdc0dd {{(pid=72441) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:27 user nova-compute[72441]: INFO nova.compute.manager [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Rescuing
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:33:27 user nova-compute[72441]: DEBUG nova.network.neutron [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:33:28 user nova-compute[72441]: DEBUG nova.network.neutron [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:33:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance destroyed successfully.
Aug 09 19:33:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Attempting rescue
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:33:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Creating image(s)
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'trusted_certs' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:29 user nova-compute[72441]: WARNING nova.compute.manager [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state active and task_state rescuing.
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:29 user nova-compute[72441]: WARNING nova.compute.manager [req-34e029c3-5886-4800-ae62-57960a34e6d0 req-b56fb5ec-3900-4185-ab06-32a542b99248 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state active and task_state rescuing.
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue" returned: 0 in 0.054s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'migration_context' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Start _get_guest_xml network_info=[{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:c2:34:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'resources' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'numa_topology' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:29 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:33:29 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152882460',display_name='tempest-ServerRescueNegativeTestJSON-server-152882460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152882460',id=35,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHiNOr7xUPGpClsjxDVaXRr3F1M5nVTuSVSoSSB8LlY/Btu8dgSl6QeUB8jA8J5sf1Cldb9evi6OA97b9SfAu4lCtRA0nPxbfFRZc/7SaTBJCx7ecA5AbO5/G+WWVyuYA==',key_name='tempest-keypair-1212364424',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-9i70dhuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=09347414-6629-463e-a3c5-c1a0a09cde71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:c2:34:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "vif_mac": "fa:16:3e:c2:34:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.objects.instance [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'pci_devices' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:33:29 user nova-compute[72441]:   <uuid>09347414-6629-463e-a3c5-c1a0a09cde71</uuid>
Aug 09 19:33:29 user nova-compute[72441]:   <name>instance-00000023</name>
Aug 09 19:33:29 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:33:29 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:33:29 user nova-compute[72441]:   <metadata>
Aug 09 19:33:29 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:33:29 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:33:29 user nova-compute[72441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-152882460</nova:name>
Aug 09 19:33:29 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:33:29</nova:creationTime>
Aug 09 19:33:29 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:33:29 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:33:29 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:33:29 user nova-compute[72441]:       <nova:owner>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:user uuid="3bdbd35f8a0d4f3297acb453e3109176">tempest-ServerRescueNegativeTestJSON-1340711293-project-member</nova:user>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:project uuid="6dcefc0bffad468b82ae957092668524">tempest-ServerRescueNegativeTestJSON-1340711293</nova:project>
Aug 09 19:33:29 user nova-compute[72441]:       </nova:owner>
Aug 09 19:33:29 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:33:29 user nova-compute[72441]:       <nova:ports>
Aug 09 19:33:29 user nova-compute[72441]:         <nova:port uuid="c803b73f-1362-4ea0-93d9-8f380651fd30">
Aug 09 19:33:29 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 19:33:29 user nova-compute[72441]:         </nova:port>
Aug 09 19:33:29 user nova-compute[72441]:       </nova:ports>
Aug 09 19:33:29 user nova-compute[72441]:     </nova:instance>
Aug 09 19:33:29 user nova-compute[72441]:   </metadata>
Aug 09 19:33:29 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:33:29 user nova-compute[72441]:     <system>
Aug 09 19:33:29 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:33:29 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:33:29 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:33:29 user nova-compute[72441]:       <entry name="serial">09347414-6629-463e-a3c5-c1a0a09cde71</entry>
Aug 09 19:33:29 user nova-compute[72441]:       <entry name="uuid">09347414-6629-463e-a3c5-c1a0a09cde71</entry>
Aug 09 19:33:29 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:33:29 user nova-compute[72441]:     </system>
Aug 09 19:33:29 user nova-compute[72441]:   </sysinfo>
Aug 09 19:33:29 user nova-compute[72441]:   <os>
Aug 09 19:33:29 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:33:29 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:33:29 user nova-compute[72441]:   </os>
Aug 09 19:33:29 user nova-compute[72441]:   <features>
Aug 09 19:33:29 user nova-compute[72441]:     <acpi/>
Aug 09 19:33:29 user nova-compute[72441]:     <apic/>
Aug 09 19:33:29 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:33:29 user nova-compute[72441]:   </features>
Aug 09 19:33:29 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:33:29 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:33:29 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:33:29 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:33:29 user nova-compute[72441]:   </clock>
Aug 09 19:33:29 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:33:29 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:33:29 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:33:29 user nova-compute[72441]:   </cpu>
Aug 09 19:33:29 user nova-compute[72441]:   <devices>
Aug 09 19:33:29 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:33:29 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:33:29 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue"/>
Aug 09 19:33:29 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:33:29 user nova-compute[72441]:     </disk>
Aug 09 19:33:29 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:33:29 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:33:29 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk"/>
Aug 09 19:33:29 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:33:29 user nova-compute[72441]:     </disk>
Aug 09 19:33:29 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:33:29 user nova-compute[72441]:       <mac address="fa:16:3e:c2:34:f0"/>
Aug 09 19:33:29 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:33:29 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:33:29 user nova-compute[72441]:       <target dev="tapc803b73f-13"/>
Aug 09 19:33:29 user nova-compute[72441]:     </interface>
Aug 09 19:33:29 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:33:29 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/console.log" append="off"/>
Aug 09 19:33:29 user nova-compute[72441]:     </serial>
Aug 09 19:33:29 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:33:29 user nova-compute[72441]:     <video>
Aug 09 19:33:29 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:33:29 user nova-compute[72441]:     </video>
Aug 09 19:33:29 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:33:29 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:33:29 user nova-compute[72441]:     </rng>
Aug 09 19:33:29 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:33:29 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:33:29 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:33:29 user nova-compute[72441]:     </memballoon>
Aug 09 19:33:29 user nova-compute[72441]:   </devices>
Aug 09 19:33:29 user nova-compute[72441]: </domain>
Aug 09 19:33:29 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:33:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance destroyed successfully.
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:33:29 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] No VIF found with MAC fa:16:3e:c2:34:f0, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:33:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:30 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609595.9941747, 6294a114-45f2-45f4-bfd3-a99fd3c7b61d => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:30 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] VM Stopped (Lifecycle Event)
Aug 09 19:33:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-40a5190b-1797-47aa-89c7-38aa56535349 None None] [instance: 6294a114-45f2-45f4-bfd3-a99fd3c7b61d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-4b920f12-102c-498f-b204-f38e9109984a req-5a61bf56-6645-4872-a25a-5f2c6913a232 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4b920f12-102c-498f-b204-f38e9109984a req-5a61bf56-6645-4872-a25a-5f2c6913a232 service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4b920f12-102c-498f-b204-f38e9109984a req-5a61bf56-6645-4872-a25a-5f2c6913a232 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4b920f12-102c-498f-b204-f38e9109984a req-5a61bf56-6645-4872-a25a-5f2c6913a232 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-4b920f12-102c-498f-b204-f38e9109984a req-5a61bf56-6645-4872-a25a-5f2c6913a232 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:31 user nova-compute[72441]: WARNING nova.compute.manager [req-4b920f12-102c-498f-b204-f38e9109984a req-5a61bf56-6645-4872-a25a-5f2c6913a232 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state active and task_state rescuing.
Aug 09 19:33:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 09347414-6629-463e-a3c5-c1a0a09cde71 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609613.1896284, 09347414-6629-463e-a3c5-c1a0a09cde71 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:33 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Resumed (Lifecycle Event)
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-78c515ff-7cfb-4067-91ca-d17b03af653a tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:33:33 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609613.192208, 09347414-6629-463e-a3c5-c1a0a09cde71 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:33 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Started (Lifecycle Event)
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-a1790327-c352-4853-bebe-9c1244e86d33 req-a2b0d772-53bb-416e-b213-21dd004b1cda service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a1790327-c352-4853-bebe-9c1244e86d33 req-a2b0d772-53bb-416e-b213-21dd004b1cda service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a1790327-c352-4853-bebe-9c1244e86d33 req-a2b0d772-53bb-416e-b213-21dd004b1cda service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a1790327-c352-4853-bebe-9c1244e86d33 req-a2b0d772-53bb-416e-b213-21dd004b1cda service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-a1790327-c352-4853-bebe-9c1244e86d33 req-a2b0d772-53bb-416e-b213-21dd004b1cda service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:33 user nova-compute[72441]: WARNING nova.compute.manager [req-a1790327-c352-4853-bebe-9c1244e86d33 req-a2b0d772-53bb-416e-b213-21dd004b1cda service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state active and task_state rescuing.
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:33:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:33:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:33:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:33:34 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [{"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-4eb07fb7-1056-44f7-a6df-c2d42c64c393" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609601.3108892, 367fad76-d6ba-49c5-8595-6b4a7f05c6a0 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:36 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] VM Stopped (Lifecycle Event)
Aug 09 19:33:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1b710709-a5ff-4e59-a768-6ec97cc53f99 None None] [instance: 367fad76-d6ba-49c5-8595-6b4a7f05c6a0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:33:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=25.001705169677734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 822fd908-82ec-4e6c-bcab-b190213e67e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance a4dd294f-e0ff-41f7-a717-1b383d10b00e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 471adda1-bc0b-42e6-9476-206c9ec9b58f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:38 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:33:40 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609605.5303652, 3e84de40-d220-4cd6-8ef3-a04c7231fa16 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:33:40 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] VM Stopped (Lifecycle Event)
Aug 09 19:33:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-94d707f6-6382-42e8-af53-83f17abead9b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:33:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 req-81bf441f-f6d1-4978-8670-48f062e5b3bf service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event volume-reimaged-49ef235c-5b35-4e62-9301-54435ccdc0dd {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 req-81bf441f-f6d1-4978-8670-48f062e5b3bf service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 req-81bf441f-f6d1-4978-8670-48f062e5b3bf service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 req-81bf441f-f6d1-4978-8670-48f062e5b3bf service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 req-81bf441f-f6d1-4978-8670-48f062e5b3bf service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Processing event volume-reimaged-49ef235c-5b35-4e62-9301-54435ccdc0dd {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:33:46 user nova-compute[72441]: INFO nova.virt.block_device [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Booting with volume 49ef235c-5b35-4e62-9301-54435ccdc0dd at /dev/vda
Aug 09 19:33:46 user nova-compute[72441]: DEBUG os_brick.utils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5794466c-5623-4cc2-9cd3-bf737bb54264]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5c258f-8d57-49d0-96be-0eedd2e296f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee1795f-e679-44b8-8420-5cfef9657d2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33658827-b4ac-40d2-9491-7b83b64468c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:33:47 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:33:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5499912f-4bf3-4e29-9002-0c31b9dcb6b2]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG os_brick.utils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:47 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating existing volume attachment record: 39c94f6d-94c7-463c-a0ce-bc26e91d5f66 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:49 user nova-compute[72441]: INFO nova.compute.manager [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Terminating instance
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-a6cef8ce-5483-459c-be87-88861426461f req-1bcfc69b-89a2-4292-a6ad-12d933f53f2a service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-unplugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a6cef8ce-5483-459c-be87-88861426461f req-1bcfc69b-89a2-4292-a6ad-12d933f53f2a service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a6cef8ce-5483-459c-be87-88861426461f req-1bcfc69b-89a2-4292-a6ad-12d933f53f2a service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a6cef8ce-5483-459c-be87-88861426461f req-1bcfc69b-89a2-4292-a6ad-12d933f53f2a service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-a6cef8ce-5483-459c-be87-88861426461f req-1bcfc69b-89a2-4292-a6ad-12d933f53f2a service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-unplugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.compute.manager [req-a6cef8ce-5483-459c-be87-88861426461f req-1bcfc69b-89a2-4292-a6ad-12d933f53f2a service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-unplugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:33:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Instance destroyed successfully.
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.objects.instance [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lazy-loading 'resources' on Instance uuid 471adda1-bc0b-42e6-9476-206c9ec9b58f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-121406836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-121406836',id=31,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaOjCy7otZPDTbCdIVBaOk1sjHOF0X+g86O3I2SFeW28nsz8beaJ7hQOaJdOgfKXTQiybezEpi3RTHMAohT9IR6pOmSEpJbj25Ui1FOILwGGah+hV5pwYXxHaBdg6ULDQ==',key_name='tempest-keypair-1680402287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f8e21260bfe4c228b1f97b1dbb7a049',ramdisk_id='',reservation_id='r-77vjub3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1792449968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1792449968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='890855d048044ea89e304b9fc38b7600',uuid=471adda1-bc0b-42e6-9476-206c9ec9b58f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converting VIF {"id": "e3a03733-e309-4dbd-bb21-c902f5136858", "address": "fa:16:3e:86:76:98", "network": {"id": "4ca44a30-c8d6-4de0-8285-236167f1839b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1698505104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f8e21260bfe4c228b1f97b1dbb7a049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3a03733-e3", "ovs_interfaceid": "e3a03733-e309-4dbd-bb21-c902f5136858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG os_vif [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3a03733-e3, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: INFO os_vif [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:98,bridge_name='br-int',has_traffic_filtering=True,id=e3a03733-e309-4dbd-bb21-c902f5136858,network=Network(4ca44a30-c8d6-4de0-8285-236167f1839b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3a03733-e3')
Aug 09 19:33:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Deleting instance files /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f_del
Aug 09 19:33:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Deletion of /opt/stack/data/nova/instances/471adda1-bc0b-42e6-9476-206c9ec9b58f_del complete
Aug 09 19:33:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:49 user nova-compute[72441]: INFO nova.compute.manager [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 09 19:33:49 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:33:49 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:33:50 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:33:50 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Took 0.87 seconds to deallocate network for instance.
Aug 09 19:33:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-fbc57fc3-78b8-4eb1-a87c-98effbfb1946 req-31ba650b-9034-4081-9b97-467c3f13bcd0 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-deleted-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:51 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Deleted allocations for instance 471adda1-bc0b-42e6-9476-206c9ec9b58f
Aug 09 19:33:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-32d1eb95-fe73-46d8-bbfc-3ed0bba5e8d9 tempest-AttachVolumeShelveTestJSON-1792449968 tempest-AttachVolumeShelveTestJSON-1792449968-project-member] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.063s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-e4307d9f-b096-4c16-a3e1-63849c1568c1 req-0058bdb6-0458-43f7-bd09-7c9866cad261 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e4307d9f-b096-4c16-a3e1-63849c1568c1 req-0058bdb6-0458-43f7-bd09-7c9866cad261 service nova] Acquiring lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e4307d9f-b096-4c16-a3e1-63849c1568c1 req-0058bdb6-0458-43f7-bd09-7c9866cad261 service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e4307d9f-b096-4c16-a3e1-63849c1568c1 req-0058bdb6-0458-43f7-bd09-7c9866cad261 service nova] Lock "471adda1-bc0b-42e6-9476-206c9ec9b58f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-e4307d9f-b096-4c16-a3e1-63849c1568c1 req-0058bdb6-0458-43f7-bd09-7c9866cad261 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] No waiting events found dispatching network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:51 user nova-compute[72441]: WARNING nova.compute.manager [req-e4307d9f-b096-4c16-a3e1-63849c1568c1 req-0058bdb6-0458-43f7-bd09-7c9866cad261 service nova] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Received unexpected event network-vif-plugged-e3a03733-e309-4dbd-bb21-c902f5136858 for instance with vm_state deleted and task_state None.
Aug 09 19:33:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:33:55 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Creating image(s)
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Ensure instance console log exists: /opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Start _get_guest_xml network_info=[{"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e84de40-d220-4cd6-8ef3-a04c7231fa16', 'attached_at': '', 'detached_at': '', 'volume_id': '49ef235c-5b35-4e62-9301-54435ccdc0dd', 'serial': '49ef235c-5b35-4e62-9301-54435ccdc0dd'}, 'attachment_id': '39c94f6d-94c7-463c-a0ce-bc26e91d5f66', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:33:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 19:33:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:33:55 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:33:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:55 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 19:33:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:33:55 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:33:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c9f11-1bce-414b-9db0-48c7d1a692ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:33:55 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec3825-e4ab-49a7-a126-b9fb3b92b59a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd] added
Aug 09 19:33:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2dc21-49d1-4b5b-b557-6e4a72615ebd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb636691-3ad7-44d5-95d5-856a57dd55aa]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OYnErgau {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OYnErgau" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f3d19-f70c-4436-ab9d-aef2799b0ba1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OYnErgau'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3677d6df-7499-4cab-a701-3b622605df22]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[097634e9-a2c5-46b8-9d8a-b8a393488d80]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ae23f-e5fa-44dd-9b03-7e32e7811845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]
Aug 09 19:33:56 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.
Aug 09 19:33:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29fd29-dc1b-4776-ae3a-a0518f93a88c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b14c067-9578-47f2-829b-783a026fdb32]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:33:56 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:33:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1e1a0-237c-4668-a79a-0a3b5a93c1c6]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:33:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23562366333313961', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562366333313961', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1036900387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126806307',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn6IYeMd96nC/HkLCWeqjt3nj9VxcvE5MKXvpO83n23Xk5XmyKKsUNIHpCpNfVuuwcZxyTcLjQF4qk3j7RY9tOO7Zsa5OSPOcGTl72Q90ZYkpWi/v+v56ekPIandwKlqw==',key_name='tempest-keypair-506233433',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:31:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='985b7412ae7848a9ac95b7f14a2aa4da',ramdisk_id='',reservation_id='r-10rftg7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-264129131',owner_user_name='tempest-ServerActionsV293TestJSON-264129131-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47342db0cd34582b51a1ce8e024e8a8',uuid=3e84de40-d220-4cd6-8ef3-a04c7231fa16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converting VIF {"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:33:57 user nova-compute[72441]:   <uuid>3e84de40-d220-4cd6-8ef3-a04c7231fa16</uuid>
Aug 09 19:33:57 user nova-compute[72441]:   <name>instance-00000025</name>
Aug 09 19:33:57 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:33:57 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:33:57 user nova-compute[72441]:   <metadata>
Aug 09 19:33:57 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:33:57 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:33:57 user nova-compute[72441]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1036900387</nova:name>
Aug 09 19:33:57 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:33:55</nova:creationTime>
Aug 09 19:33:57 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:33:57 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:33:57 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:33:57 user nova-compute[72441]:       <nova:owner>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:user uuid="f47342db0cd34582b51a1ce8e024e8a8">tempest-ServerActionsV293TestJSON-264129131-project-member</nova:user>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:project uuid="985b7412ae7848a9ac95b7f14a2aa4da">tempest-ServerActionsV293TestJSON-264129131</nova:project>
Aug 09 19:33:57 user nova-compute[72441]:       </nova:owner>
Aug 09 19:33:57 user nova-compute[72441]:       <nova:ports>
Aug 09 19:33:57 user nova-compute[72441]:         <nova:port uuid="2eeb6e35-7f61-452f-acd1-492a42fb5499">
Aug 09 19:33:57 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:33:57 user nova-compute[72441]:         </nova:port>
Aug 09 19:33:57 user nova-compute[72441]:       </nova:ports>
Aug 09 19:33:57 user nova-compute[72441]:     </nova:instance>
Aug 09 19:33:57 user nova-compute[72441]:   </metadata>
Aug 09 19:33:57 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:33:57 user nova-compute[72441]:     <system>
Aug 09 19:33:57 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:33:57 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:33:57 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:33:57 user nova-compute[72441]:       <entry name="serial">3e84de40-d220-4cd6-8ef3-a04c7231fa16</entry>
Aug 09 19:33:57 user nova-compute[72441]:       <entry name="uuid">3e84de40-d220-4cd6-8ef3-a04c7231fa16</entry>
Aug 09 19:33:57 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:33:57 user nova-compute[72441]:     </system>
Aug 09 19:33:57 user nova-compute[72441]:   </sysinfo>
Aug 09 19:33:57 user nova-compute[72441]:   <os>
Aug 09 19:33:57 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:33:57 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:33:57 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:33:57 user nova-compute[72441]:   </os>
Aug 09 19:33:57 user nova-compute[72441]:   <features>
Aug 09 19:33:57 user nova-compute[72441]:     <acpi/>
Aug 09 19:33:57 user nova-compute[72441]:     <apic/>
Aug 09 19:33:57 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:33:57 user nova-compute[72441]:   </features>
Aug 09 19:33:57 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:33:57 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:33:57 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:33:57 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:33:57 user nova-compute[72441]:   </clock>
Aug 09 19:33:57 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:33:57 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:33:57 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:33:57 user nova-compute[72441]:   </cpu>
Aug 09 19:33:57 user nova-compute[72441]:   <devices>
Aug 09 19:33:57 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:33:57 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:33:57 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:33:57 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:33:57 user nova-compute[72441]:       <serial>49ef235c-5b35-4e62-9301-54435ccdc0dd</serial>
Aug 09 19:33:57 user nova-compute[72441]:     </disk>
Aug 09 19:33:57 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:33:57 user nova-compute[72441]:       <mac address="fa:16:3e:df:6a:c2"/>
Aug 09 19:33:57 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:33:57 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:33:57 user nova-compute[72441]:       <target dev="tap2eeb6e35-7f"/>
Aug 09 19:33:57 user nova-compute[72441]:     </interface>
Aug 09 19:33:57 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:33:57 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16/console.log" append="off"/>
Aug 09 19:33:57 user nova-compute[72441]:     </serial>
Aug 09 19:33:57 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:33:57 user nova-compute[72441]:     <video>
Aug 09 19:33:57 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:33:57 user nova-compute[72441]:     </video>
Aug 09 19:33:57 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:33:57 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:33:57 user nova-compute[72441]:     </rng>
Aug 09 19:33:57 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:33:57 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:33:57 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:33:57 user nova-compute[72441]:     </memballoon>
Aug 09 19:33:57 user nova-compute[72441]:   </devices>
Aug 09 19:33:57 user nova-compute[72441]: </domain>
Aug 09 19:33:57 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1036900387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126806307',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn6IYeMd96nC/HkLCWeqjt3nj9VxcvE5MKXvpO83n23Xk5XmyKKsUNIHpCpNfVuuwcZxyTcLjQF4qk3j7RY9tOO7Zsa5OSPOcGTl72Q90ZYkpWi/v+v56ekPIandwKlqw==',key_name='tempest-keypair-506233433',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:31:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='985b7412ae7848a9ac95b7f14a2aa4da',ramdisk_id='',reservation_id='r-10rftg7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-264129131',owner_user_name='tempest-ServerActionsV293TestJSON-264129131-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47342db0cd34582b51a1ce8e024e8a8',uuid=3e84de40-d220-4cd6-8ef3-a04c7231fa16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converting VIF {"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG os_vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eeb6e35-7f, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eeb6e35-7f, col_values=(('external_ids', {'iface-id': '2eeb6e35-7f61-452f-acd1-492a42fb5499', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:6a:c2', 'vm-uuid': '3e84de40-d220-4cd6-8ef3-a04c7231fa16'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:57 user nova-compute[72441]: INFO os_vif [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f')
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:33:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] No VIF found with MAC fa:16:3e:df:6a:c2, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-3efed6bd-92eb-4266-a583-360c168dda81 req-07e47257-646d-4ac5-b28d-950059e1c954 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3efed6bd-92eb-4266-a583-360c168dda81 req-07e47257-646d-4ac5-b28d-950059e1c954 service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3efed6bd-92eb-4266-a583-360c168dda81 req-07e47257-646d-4ac5-b28d-950059e1c954 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3efed6bd-92eb-4266-a583-360c168dda81 req-07e47257-646d-4ac5-b28d-950059e1c954 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:33:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-3efed6bd-92eb-4266-a583-360c168dda81 req-07e47257-646d-4ac5-b28d-950059e1c954 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:33:58 user nova-compute[72441]: WARNING nova.compute.manager [req-3efed6bd-92eb-4266-a583-360c168dda81 req-07e47257-646d-4ac5-b28d-950059e1c954 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 19:33:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:33:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-b697c543-78b6-47dd-a42a-dff46efe5369 req-603d85e7-6b5b-462d-ab54-8cc725fc5df2 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b697c543-78b6-47dd-a42a-dff46efe5369 req-603d85e7-6b5b-462d-ab54-8cc725fc5df2 service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b697c543-78b6-47dd-a42a-dff46efe5369 req-603d85e7-6b5b-462d-ab54-8cc725fc5df2 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b697c543-78b6-47dd-a42a-dff46efe5369 req-603d85e7-6b5b-462d-ab54-8cc725fc5df2 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-b697c543-78b6-47dd-a42a-dff46efe5369 req-603d85e7-6b5b-462d-ab54-8cc725fc5df2 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:00 user nova-compute[72441]: WARNING nova.compute.manager [req-b697c543-78b6-47dd-a42a-dff46efe5369 req-603d85e7-6b5b-462d-ab54-8cc725fc5df2 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609640.9732733, 3e84de40-d220-4cd6-8ef3-a04c7231fa16 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] VM Resumed (Lifecycle Event)
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:00 user nova-compute[72441]: INFO nova.compute.manager [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Terminating instance
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:34:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance spawned successfully.
Aug 09 19:34:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609640.9737103, 3e84de40-d220-4cd6-8ef3-a04c7231fa16 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] VM Started (Lifecycle Event)
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72441) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-9d7f5c14-c835-41e9-86ed-0c8586acbc5b req-b02003cf-64d8-4c93-b4d6-478f74274fee service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-unplugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9d7f5c14-c835-41e9-86ed-0c8586acbc5b req-b02003cf-64d8-4c93-b4d6-478f74274fee service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9d7f5c14-c835-41e9-86ed-0c8586acbc5b req-b02003cf-64d8-4c93-b4d6-478f74274fee service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9d7f5c14-c835-41e9-86ed-0c8586acbc5b req-b02003cf-64d8-4c93-b4d6-478f74274fee service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-9d7f5c14-c835-41e9-86ed-0c8586acbc5b req-b02003cf-64d8-4c93-b4d6-478f74274fee service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-unplugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-9d7f5c14-c835-41e9-86ed-0c8586acbc5b req-b02003cf-64d8-4c93-b4d6-478f74274fee service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-unplugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8ec98cb4-f550-4771-9b55-e9e1ec01fef7 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Instance destroyed successfully.
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lazy-loading 'resources' on Instance uuid 822fd908-82ec-4e6c-bcab-b190213e67e7 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028222133',display_name='tempest-ServerActionsTestOtherA-server-521700190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028222133',id=4,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xS3mATfiRs6iC3W/nixYMjcPb8mr8asYtjlRTdTKV2vm/QOdEBcCcunuP5IYxxD6EsjP1Vy3Tj/tqAxrTUR+T8LXT/NJkI/G/IAzpMQdm49hM3zNVOli/AV4WE8X3jA==',key_name='tempest-keypair-449041090',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:21:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4775870464a74454992c156806470beb',ramdisk_id='',reservation_id='r-1szv9zr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-683008927',owner_user_name='tempest-ServerActionsTestOtherA-683008927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d604b2b0d64d9285df9088ee2e8c80',uuid=822fd908-82ec-4e6c-bcab-b190213e67e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converting VIF {"id": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "address": "fa:16:3e:4a:6e:8f", "network": {"id": "f20d912d-f687-4610-a9e1-471941a37a3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394253733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4775870464a74454992c156806470beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaae0b6a1-41", "ovs_interfaceid": "aae0b6a1-4106-4bbe-b283-e728f6dca34e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG os_vif [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaae0b6a1-41, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:34:01 user nova-compute[72441]: INFO os_vif [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6e:8f,bridge_name='br-int',has_traffic_filtering=True,id=aae0b6a1-4106-4bbe-b283-e728f6dca34e,network=Network(f20d912d-f687-4610-a9e1-471941a37a3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaae0b6a1-41')
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Deleting instance files /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7_del
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Deletion of /opt/stack/data/nova/instances/822fd908-82ec-4e6c-bcab-b190213e67e7_del complete
Aug 09 19:34:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:01 user nova-compute[72441]: INFO nova.compute.manager [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 09 19:34:01 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:34:01 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:02 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Took 0.69 seconds to deallocate network for instance.
Aug 09 19:34:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-14d6478c-8cad-43f4-af53-ba163ced87b1 req-899b39de-b0aa-47a6-9bde-314ee63ee677 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-deleted-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:03 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Deleted allocations for instance 822fd908-82ec-4e6c-bcab-b190213e67e7
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-de7c157a-7816-41ea-b6f2-56cb12e73e37 tempest-ServerActionsTestOtherA-683008927 tempest-ServerActionsTestOtherA-683008927-project-member] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:03 user nova-compute[72441]: WARNING nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state deleted and task_state None.
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:03 user nova-compute[72441]: WARNING nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state deleted and task_state None.
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:03 user nova-compute[72441]: WARNING nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state deleted and task_state None.
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Acquiring lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] Lock "822fd908-82ec-4e6c-bcab-b190213e67e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] No waiting events found dispatching network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:03 user nova-compute[72441]: WARNING nova.compute.manager [req-de8e202e-a85d-4ef7-ac07-a117dc883bb3 req-7909a1d0-df19-429a-b3b1-b614007176a5 service nova] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Received unexpected event network-vif-plugged-aae0b6a1-4106-4bbe-b283-e728f6dca34e for instance with vm_state deleted and task_state None.
Aug 09 19:34:04 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609629.7345786, 471adda1-bc0b-42e6-9476-206c9ec9b58f => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:04 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] VM Stopped (Lifecycle Event)
Aug 09 19:34:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f5c7fd35-7f9e-4c86-86ce-6407bde7216b None None] [instance: 471adda1-bc0b-42e6-9476-206c9ec9b58f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 14cc7eae-5cdf-4325-871c-14db3f9507e0 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:34:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:16 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609641.7988644, 822fd908-82ec-4e6c-bcab-b190213e67e7 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:16 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] VM Stopped (Lifecycle Event)
Aug 09 19:34:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a3e99605-1cfa-473d-a843-7e4d8ba09b41 None None] [instance: 822fd908-82ec-4e6c-bcab-b190213e67e7] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:32 user nova-compute[72441]: INFO nova.compute.manager [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Terminating instance
Aug 09 19:34:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-0cd82d55-4564-491f-a13f-1b8b6872ecb6 req-d9c7794d-ffd3-4dcc-850d-57d65bb99f10 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0cd82d55-4564-491f-a13f-1b8b6872ecb6 req-d9c7794d-ffd3-4dcc-850d-57d65bb99f10 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0cd82d55-4564-491f-a13f-1b8b6872ecb6 req-d9c7794d-ffd3-4dcc-850d-57d65bb99f10 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0cd82d55-4564-491f-a13f-1b8b6872ecb6 req-d9c7794d-ffd3-4dcc-850d-57d65bb99f10 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-0cd82d55-4564-491f-a13f-1b8b6872ecb6 req-d9c7794d-ffd3-4dcc-850d-57d65bb99f10 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-0cd82d55-4564-491f-a13f-1b8b6872ecb6 req-d9c7794d-ffd3-4dcc-850d-57d65bb99f10 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-unplugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Instance destroyed successfully.
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'resources' on Instance uuid a4dd294f-e0ff-41f7-a717-1b383d10b00e {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2002161486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2002161486',id=32,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-yl09rnos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:32:47Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=a4dd294f-e0ff-41f7-a717-1b383d10b00e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "address": "fa:16:3e:6c:50:7b", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b085d4-02", "ovs_interfaceid": "e1b085d4-02b4-411f-bd06-b5f200ef8540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_vif [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1b085d4-02, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:34:33 user nova-compute[72441]: INFO os_vif [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=e1b085d4-02b4-411f-bd06-b5f200ef8540,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b085d4-02')
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lRZUywHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:34:33 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.043s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be7245c-3d04-4ce4-b9fd-ebe057ab7ae1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38a559-eba2-419e-9267-fe4b44cb3486]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:34:33 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:34:33 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:34:33 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:34:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:34:33 user nova-compute[72441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d (non-flash)
Aug 09 19:34:33 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:34:33 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:34:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbda51a4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc236d66-b0b4-42cd-8e5b-c33cb47a90b6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8e3db-b798-4b9d-ba1c-689809a4663d]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277e5c2-d61f-4205-b65d-8c93fd01855a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24deb918-388c-4782-abe5-619f4c1f5ae2]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc1e29d-5f22-4966-b25d-8b502dbbf7b1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3fc94f-6e71-46d6-9495-590b4791c5ca]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260]
Aug 09 19:34:33 user nova-compute[72441]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d, portal: 172.16.0.220,3260] successful.
Aug 09 19:34:33 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d370af45-3cdf-460c-9bdb-087b5cb54a5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f452b0-a89b-4b85-983c-3ba013be220f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== disconnect_volume: return (406ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:34:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Deleting instance files /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e_del
Aug 09 19:34:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Deletion of /opt/stack/data/nova/instances/a4dd294f-e0ff-41f7-a717-1b383d10b00e_del complete
Aug 09 19:34:33 user nova-compute[72441]: INFO nova.compute.manager [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 09 19:34:33 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:34:33 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:34:34 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Took 0.53 seconds to deallocate network for instance.
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-3762bd5d-f94c-42c6-8f82-be6872980338 req-d4866cf3-7975-4291-b2bb-07342b0d65c0 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-deleted-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-801f110d-26b1-4ee0-ac3f-7fd9fdffc943 req-9c7c55bd-2603-41cf-bcb3-5e03fbdf54f6 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-801f110d-26b1-4ee0-ac3f-7fd9fdffc943 req-9c7c55bd-2603-41cf-bcb3-5e03fbdf54f6 service nova] Acquiring lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-801f110d-26b1-4ee0-ac3f-7fd9fdffc943 req-9c7c55bd-2603-41cf-bcb3-5e03fbdf54f6 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-801f110d-26b1-4ee0-ac3f-7fd9fdffc943 req-9c7c55bd-2603-41cf-bcb3-5e03fbdf54f6 service nova] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-801f110d-26b1-4ee0-ac3f-7fd9fdffc943 req-9c7c55bd-2603-41cf-bcb3-5e03fbdf54f6 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] No waiting events found dispatching network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:35 user nova-compute[72441]: WARNING nova.compute.manager [req-801f110d-26b1-4ee0-ac3f-7fd9fdffc943 req-9c7c55bd-2603-41cf-bcb3-5e03fbdf54f6 service nova] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Received unexpected event network-vif-plugged-e1b085d4-02b4-411f-bd06-b5f200ef8540 for instance with vm_state active and task_state deleting.
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:34:37 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=25.028358459472656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance a4dd294f-e0ff-41f7-a717-1b383d10b00e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "98d0d122-7e57-4f77-9581-3447e9672e36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:37 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:34:37 user nova-compute[72441]: INFO nova.compute.claims [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Claim successful on node user
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:34:38 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:34:38 user nova-compute[72441]: INFO nova.virt.block_device [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Booting with volume 21c659ea-fe35-4e43-a5fa-9080d1e1f280 at /dev/vda
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.policy [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd066b4d22049d0b2129ad1f38ef9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ae81254564eadaf8042330cb1fdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG os_brick.utils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ade04-0ec9-4950-a8b5-0d7e4d65b9f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef33b76-d03b-4bb8-ac28-1288c0af8be1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd245aa-61b1-46de-8268-f63dcb94afe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b9ea17-9bb6-4455-a563-3873a4a8ef1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:34:38 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcd7966-14e3-4d85-b785-5e8220b4cba1]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG os_brick.utils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updating existing volume attachment record: ddd1c5d6-2adb-4606-a33f-05e438d841b0 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:34:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Successfully created port: a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Successfully updated port: a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquired lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-changed-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.compute.manager [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Refreshing instance network info cache due to event network-changed-a49642b5-a644-4f8b-bda5-d8aabcb3946c. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] Acquiring lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:34:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG nova.network.neutron [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updating instance_info_cache with network_info: [{"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Releasing lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Instance network_info: |[{"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] Acquired lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Refreshing network info cache for port a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updated VIF entry in instance network info cache for port a49642b5-a644-4f8b-bda5-d8aabcb3946c. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updating instance_info_cache with network_info: [{"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:34:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3d952c42-b6ef-4403-969b-f218130e838d req-04951bc9-bea7-483a-b047-410a8ee202cc service nova] Releasing lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:34:43 user nova-compute[72441]: INFO nova.compute.manager [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Took 9.37 seconds to detach 1 volumes for instance.
Aug 09 19:34:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:43 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:34:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:44 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Deleted allocations for instance a4dd294f-e0ff-41f7-a717-1b383d10b00e
Aug 09 19:34:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9cc1d9ae-17b2-473c-8352-d0a7ea1efbaa tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "a4dd294f-e0ff-41f7-a717-1b383d10b00e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.940s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609673.4108653, a4dd294f-e0ff-41f7-a717-1b383d10b00e => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:48 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] VM Stopped (Lifecycle Event)
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-082c0627-abca-4aef-9543-8b04eedafd82 None None] [instance: a4dd294f-e0ff-41f7-a717-1b383d10b00e] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:34:48 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Creating image(s)
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Ensure instance console log exists: /opt/stack/data/nova/instances/98d0d122-7e57-4f77-9581-3447e9672e36/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Start _get_guest_xml network_info=[{"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpHRBXil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98d0d122-7e57-4f77-9581-3447e9672e36', 'attached_at': '', 'detached_at': '', 'volume_id': '21c659ea-fe35-4e43-a5fa-9080d1e1f280', 'serial': '21c659ea-fe35-4e43-a5fa-9080d1e1f280'}, 'attachment_id': 'ddd1c5d6-2adb-4606-a33f-05e438d841b0', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:34:48 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:34:48 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpHRBXil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:34:48 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:34:48 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:34:48 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4fe19c-555d-4ee8-8215-ccc5ad7fa57f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:34:48 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fae3c5f-6835-401a-866e-e8fe2e1dc2d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280] added
Aug 09 19:34:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e2a7e4-03ab-4d13-a478-3be7c9a6fd08]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f622ec-926c-4466-8a6e-e7a6efed130f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpHRBXil {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpHRBXil" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8b93d-f073-4fe5-8b6c-8fbfff7f46b5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UpHRBXil'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f8b54e-73ed-4dfb-b94f-ee183869c4a2]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc9c87a-e654-4551-ada1-1a997148797a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2910c-faae-492b-8e60-8eda1b943a12 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2910c-faae-492b-8e60-8eda1b943a12 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2910c-faae-492b-8e60-8eda1b943a12 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0731384c-d0cd-4af6-9ab6-624d87c70d92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260]
Aug 09 19:34:48 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260] successful.
Aug 09 19:34:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef82be2-3fef-49dc-aea6-f812b8c9c626]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c91ecb-a4c5-4269-b908-756c2c78b7b0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2910c-faae-492b-8e60-8eda1b943a12 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2910c-faae-492b-8e60-8eda1b943a12 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a2910c-faae-492b-8e60-8eda1b943a12 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:34:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc75965-ab09-477c-b78f-1d102671914b]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:34:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpHRBXil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23336363739653233', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336363739653233', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-89748341',display_name='tempest-TestVolumeBootPattern-volume-backed-server-89748341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-89748341',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZs+YWiWzAL3kBR8JlVwPkYzWkZaRh50zJW40CFOqclROO4LunUXeCOaloEFMiyA1iGLk6cZXw2C5Vw53ZsdjbHBflO6ouQXbT6G+Xii9wshvvFYi3IuVt9tb7Htt6udw==',key_name='tempest-keypair-1280248523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-ladzrsyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=98d0d122-7e57-4f77-9581-3447e9672e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.objects.instance [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'pci_devices' on Instance uuid 98d0d122-7e57-4f77-9581-3447e9672e36 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:34:49 user nova-compute[72441]:   <uuid>98d0d122-7e57-4f77-9581-3447e9672e36</uuid>
Aug 09 19:34:49 user nova-compute[72441]:   <name>instance-00000026</name>
Aug 09 19:34:49 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:34:49 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:34:49 user nova-compute[72441]:   <metadata>
Aug 09 19:34:49 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:34:49 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:34:49 user nova-compute[72441]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-89748341</nova:name>
Aug 09 19:34:49 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:34:48</nova:creationTime>
Aug 09 19:34:49 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:34:49 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:34:49 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:34:49 user nova-compute[72441]:       <nova:owner>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:user uuid="0fd066b4d22049d0b2129ad1f38ef9e4">tempest-TestVolumeBootPattern-1486219267-project-member</nova:user>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:project uuid="256ae81254564eadaf8042330cb1fdce">tempest-TestVolumeBootPattern-1486219267</nova:project>
Aug 09 19:34:49 user nova-compute[72441]:       </nova:owner>
Aug 09 19:34:49 user nova-compute[72441]:       <nova:ports>
Aug 09 19:34:49 user nova-compute[72441]:         <nova:port uuid="a49642b5-a644-4f8b-bda5-d8aabcb3946c">
Aug 09 19:34:49 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 19:34:49 user nova-compute[72441]:         </nova:port>
Aug 09 19:34:49 user nova-compute[72441]:       </nova:ports>
Aug 09 19:34:49 user nova-compute[72441]:     </nova:instance>
Aug 09 19:34:49 user nova-compute[72441]:   </metadata>
Aug 09 19:34:49 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:34:49 user nova-compute[72441]:     <system>
Aug 09 19:34:49 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:34:49 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:34:49 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:34:49 user nova-compute[72441]:       <entry name="serial">98d0d122-7e57-4f77-9581-3447e9672e36</entry>
Aug 09 19:34:49 user nova-compute[72441]:       <entry name="uuid">98d0d122-7e57-4f77-9581-3447e9672e36</entry>
Aug 09 19:34:49 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:34:49 user nova-compute[72441]:     </system>
Aug 09 19:34:49 user nova-compute[72441]:   </sysinfo>
Aug 09 19:34:49 user nova-compute[72441]:   <os>
Aug 09 19:34:49 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:34:49 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:34:49 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:34:49 user nova-compute[72441]:   </os>
Aug 09 19:34:49 user nova-compute[72441]:   <features>
Aug 09 19:34:49 user nova-compute[72441]:     <acpi/>
Aug 09 19:34:49 user nova-compute[72441]:     <apic/>
Aug 09 19:34:49 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:34:49 user nova-compute[72441]:   </features>
Aug 09 19:34:49 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:34:49 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:34:49 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:34:49 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:34:49 user nova-compute[72441]:   </clock>
Aug 09 19:34:49 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:34:49 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:34:49 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:34:49 user nova-compute[72441]:   </cpu>
Aug 09 19:34:49 user nova-compute[72441]:   <devices>
Aug 09 19:34:49 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:34:49 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:34:49 user nova-compute[72441]:       <source dev="/dev/sde"/>
Aug 09 19:34:49 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:34:49 user nova-compute[72441]:       <serial>21c659ea-fe35-4e43-a5fa-9080d1e1f280</serial>
Aug 09 19:34:49 user nova-compute[72441]:     </disk>
Aug 09 19:34:49 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:34:49 user nova-compute[72441]:       <mac address="fa:16:3e:14:f7:dd"/>
Aug 09 19:34:49 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:34:49 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:34:49 user nova-compute[72441]:       <target dev="tapa49642b5-a6"/>
Aug 09 19:34:49 user nova-compute[72441]:     </interface>
Aug 09 19:34:49 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:34:49 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/98d0d122-7e57-4f77-9581-3447e9672e36/console.log" append="off"/>
Aug 09 19:34:49 user nova-compute[72441]:     </serial>
Aug 09 19:34:49 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:34:49 user nova-compute[72441]:     <video>
Aug 09 19:34:49 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:34:49 user nova-compute[72441]:     </video>
Aug 09 19:34:49 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:34:49 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:34:49 user nova-compute[72441]:     </rng>
Aug 09 19:34:49 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:34:49 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:34:49 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:34:49 user nova-compute[72441]:     </memballoon>
Aug 09 19:34:49 user nova-compute[72441]:   </devices>
Aug 09 19:34:49 user nova-compute[72441]: </domain>
Aug 09 19:34:49 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-89748341',display_name='tempest-TestVolumeBootPattern-volume-backed-server-89748341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-89748341',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZs+YWiWzAL3kBR8JlVwPkYzWkZaRh50zJW40CFOqclROO4LunUXeCOaloEFMiyA1iGLk6cZXw2C5Vw53ZsdjbHBflO6ouQXbT6G+Xii9wshvvFYi3IuVt9tb7Htt6udw==',key_name='tempest-keypair-1280248523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-ladzrsyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=98d0d122-7e57-4f77-9581-3447e9672e36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG os_vif [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa49642b5-a6, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa49642b5-a6, col_values=(('external_ids', {'iface-id': 'a49642b5-a644-4f8b-bda5-d8aabcb3946c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:f7:dd', 'vm-uuid': '98d0d122-7e57-4f77-9581-3447e9672e36'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:34:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:49 user nova-compute[72441]: INFO os_vif [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6')
Aug 09 19:34:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:34:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No VIF found with MAC fa:16:3e:14:f7:dd, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-e2bec185-14b6-46ad-8cb1-dbe009a223f9 req-7c7c8f04-6afa-493f-b4ca-2f88a7145140 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2bec185-14b6-46ad-8cb1-dbe009a223f9 req-7c7c8f04-6afa-493f-b4ca-2f88a7145140 service nova] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2bec185-14b6-46ad-8cb1-dbe009a223f9 req-7c7c8f04-6afa-493f-b4ca-2f88a7145140 service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e2bec185-14b6-46ad-8cb1-dbe009a223f9 req-7c7c8f04-6afa-493f-b4ca-2f88a7145140 service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:51 user nova-compute[72441]: DEBUG nova.compute.manager [req-e2bec185-14b6-46ad-8cb1-dbe009a223f9 req-7c7c8f04-6afa-493f-b4ca-2f88a7145140 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] No waiting events found dispatching network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:51 user nova-compute[72441]: WARNING nova.compute.manager [req-e2bec185-14b6-46ad-8cb1-dbe009a223f9 req-7c7c8f04-6afa-493f-b4ca-2f88a7145140 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received unexpected event network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c for instance with vm_state building and task_state spawning.
Aug 09 19:34:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609693.6640632, 98d0d122-7e57-4f77-9581-3447e9672e36 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] VM Resumed (Lifecycle Event)
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Instance spawned successfully.
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609693.6672034, 98d0d122-7e57-4f77-9581-3447e9672e36 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] VM Started (Lifecycle Event)
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-4677fba0-4480-4cb6-ba31-fa85d35b7d52 req-5a46d0ad-5ef9-4d83-8004-a65d100ca63b service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4677fba0-4480-4cb6-ba31-fa85d35b7d52 req-5a46d0ad-5ef9-4d83-8004-a65d100ca63b service nova] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4677fba0-4480-4cb6-ba31-fa85d35b7d52 req-5a46d0ad-5ef9-4d83-8004-a65d100ca63b service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4677fba0-4480-4cb6-ba31-fa85d35b7d52 req-5a46d0ad-5ef9-4d83-8004-a65d100ca63b service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:53 user nova-compute[72441]: DEBUG nova.compute.manager [req-4677fba0-4480-4cb6-ba31-fa85d35b7d52 req-5a46d0ad-5ef9-4d83-8004-a65d100ca63b service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] No waiting events found dispatching network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:34:53 user nova-compute[72441]: WARNING nova.compute.manager [req-4677fba0-4480-4cb6-ba31-fa85d35b7d52 req-5a46d0ad-5ef9-4d83-8004-a65d100ca63b service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received unexpected event network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c for instance with vm_state building and task_state spawning.
Aug 09 19:34:53 user nova-compute[72441]: INFO nova.compute.manager [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Took 16.09 seconds to build instance.
Aug 09 19:34:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-faa80712-c12c-4e85-b6e4-848808fff913 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "98d0d122-7e57-4f77-9581-3447e9672e36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.181s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:34:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:34:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:35:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:35:11 user nova-compute[72441]: INFO nova.compute.claims [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Claim successful on node user
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:35:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.policy [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7bd4f65ca8a4bd4aedd651a92fe5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af13c3a40844c4d8d5118297e700385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:35:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Creating image(s)
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk 1073741824" returned: 0 in 0.058s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Successfully created port: 77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Cannot resize image /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'migration_context' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Ensure instance console log exists: /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Successfully updated port: 77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-changed-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing instance network info cache due to event network-changed-77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance network_info: |[{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Start _get_guest_xml network_info=[{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:35:13 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:35:13 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264463955',display_name='tempest-ServerStableDeviceRescueTest-server-264463955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264463955',id=39,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHy1xInRStakLW2kSTF45qNLLvigbDkWhk0iPsV05izR1oVogWt91j/ZWosGznSob3kCMZUTIBWEasgiyWakDo38XUYqHDIBIK8Poqu8os185qpeMp83rUzZ6CUsUZ29A==',key_name='tempest-keypair-1862592562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af13c3a40844c4d8d5118297e700385',ramdisk_id='',reservation_id='r-0hsa0nn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-449243577',owner_user_name='tempest-ServerStableDeviceRescueTest-449243577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7bd4f65ca8a4bd4aedd651a92fe5a19',uuid=1df1084d-ed05-4f3f-aad5-f8d57be3b0f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converting VIF {"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'pci_devices' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:35:13 user nova-compute[72441]:   <uuid>1df1084d-ed05-4f3f-aad5-f8d57be3b0f6</uuid>
Aug 09 19:35:13 user nova-compute[72441]:   <name>instance-00000027</name>
Aug 09 19:35:13 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:35:13 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:35:13 user nova-compute[72441]:   <metadata>
Aug 09 19:35:13 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:35:13 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:35:13 user nova-compute[72441]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-264463955</nova:name>
Aug 09 19:35:13 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:35:13</nova:creationTime>
Aug 09 19:35:13 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:35:13 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:35:13 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:35:13 user nova-compute[72441]:       <nova:owner>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:user uuid="d7bd4f65ca8a4bd4aedd651a92fe5a19">tempest-ServerStableDeviceRescueTest-449243577-project-member</nova:user>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:project uuid="4af13c3a40844c4d8d5118297e700385">tempest-ServerStableDeviceRescueTest-449243577</nova:project>
Aug 09 19:35:13 user nova-compute[72441]:       </nova:owner>
Aug 09 19:35:13 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:35:13 user nova-compute[72441]:       <nova:ports>
Aug 09 19:35:13 user nova-compute[72441]:         <nova:port uuid="77342bf2-a694-45b5-a931-061d51a3f226">
Aug 09 19:35:13 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:35:13 user nova-compute[72441]:         </nova:port>
Aug 09 19:35:13 user nova-compute[72441]:       </nova:ports>
Aug 09 19:35:13 user nova-compute[72441]:     </nova:instance>
Aug 09 19:35:13 user nova-compute[72441]:   </metadata>
Aug 09 19:35:13 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:35:13 user nova-compute[72441]:     <system>
Aug 09 19:35:13 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:35:13 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:35:13 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:35:13 user nova-compute[72441]:       <entry name="serial">1df1084d-ed05-4f3f-aad5-f8d57be3b0f6</entry>
Aug 09 19:35:13 user nova-compute[72441]:       <entry name="uuid">1df1084d-ed05-4f3f-aad5-f8d57be3b0f6</entry>
Aug 09 19:35:13 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:35:13 user nova-compute[72441]:     </system>
Aug 09 19:35:13 user nova-compute[72441]:   </sysinfo>
Aug 09 19:35:13 user nova-compute[72441]:   <os>
Aug 09 19:35:13 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:35:13 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:35:13 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:35:13 user nova-compute[72441]:   </os>
Aug 09 19:35:13 user nova-compute[72441]:   <features>
Aug 09 19:35:13 user nova-compute[72441]:     <acpi/>
Aug 09 19:35:13 user nova-compute[72441]:     <apic/>
Aug 09 19:35:13 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:35:13 user nova-compute[72441]:   </features>
Aug 09 19:35:13 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:35:13 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:35:13 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:35:13 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:35:13 user nova-compute[72441]:   </clock>
Aug 09 19:35:13 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:35:13 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:35:13 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:35:13 user nova-compute[72441]:   </cpu>
Aug 09 19:35:13 user nova-compute[72441]:   <devices>
Aug 09 19:35:13 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:35:13 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:35:13 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk"/>
Aug 09 19:35:13 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:35:13 user nova-compute[72441]:     </disk>
Aug 09 19:35:13 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:35:13 user nova-compute[72441]:       <mac address="fa:16:3e:e3:6e:3d"/>
Aug 09 19:35:13 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:35:13 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:35:13 user nova-compute[72441]:       <target dev="tap77342bf2-a6"/>
Aug 09 19:35:13 user nova-compute[72441]:     </interface>
Aug 09 19:35:13 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:35:13 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/console.log" append="off"/>
Aug 09 19:35:13 user nova-compute[72441]:     </serial>
Aug 09 19:35:13 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:35:13 user nova-compute[72441]:     <video>
Aug 09 19:35:13 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:35:13 user nova-compute[72441]:     </video>
Aug 09 19:35:13 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:35:13 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:35:13 user nova-compute[72441]:     </rng>
Aug 09 19:35:13 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:35:13 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:35:13 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:35:13 user nova-compute[72441]:     </memballoon>
Aug 09 19:35:13 user nova-compute[72441]:   </devices>
Aug 09 19:35:13 user nova-compute[72441]: </domain>
Aug 09 19:35:13 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264463955',display_name='tempest-ServerStableDeviceRescueTest-server-264463955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264463955',id=39,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHy1xInRStakLW2kSTF45qNLLvigbDkWhk0iPsV05izR1oVogWt91j/ZWosGznSob3kCMZUTIBWEasgiyWakDo38XUYqHDIBIK8Poqu8os185qpeMp83rUzZ6CUsUZ29A==',key_name='tempest-keypair-1862592562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af13c3a40844c4d8d5118297e700385',ramdisk_id='',reservation_id='r-0hsa0nn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-449243577',owner_user_name='tempest-ServerStableDeviceRescueTest-449243577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7bd4f65ca8a4bd4aedd651a92fe5a19',uuid=1df1084d-ed05-4f3f-aad5-f8d57be3b0f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converting VIF {"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG os_vif [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77342bf2-a6, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77342bf2-a6, col_values=(('external_ids', {'iface-id': '77342bf2-a694-45b5-a931-061d51a3f226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:6e:3d', 'vm-uuid': '1df1084d-ed05-4f3f-aad5-f8d57be3b0f6'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:13 user nova-compute[72441]: INFO os_vif [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6')
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No VIF found with MAC fa:16:3e:e3:6e:3d, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updated VIF entry in instance network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7a81dd81-84e9-42c5-bdc5-e0299fdfb4ce req-036e8a18-b169-4578-9eca-57627eaee71f service nova] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:35:14 user nova-compute[72441]: INFO nova.compute.claims [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Claim successful on node user
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:35:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:35:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Creating image(s)
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.policy [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'febf31bc22ae4e00a5e7be7c44708626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb19329778d94a21828a4d3d61d75217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk 1073741824" returned: 0 in 0.073s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-360e9dc7-f65a-46b3-98d5-3aae47cae358 req-5232c86a-0753-4347-9586-d759c86a4df9 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-360e9dc7-f65a-46b3-98d5-3aae47cae358 req-5232c86a-0753-4347-9586-d759c86a4df9 service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-360e9dc7-f65a-46b3-98d5-3aae47cae358 req-5232c86a-0753-4347-9586-d759c86a4df9 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-360e9dc7-f65a-46b3-98d5-3aae47cae358 req-5232c86a-0753-4347-9586-d759c86a4df9 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-360e9dc7-f65a-46b3-98d5-3aae47cae358 req-5232c86a-0753-4347-9586-d759c86a4df9 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:15 user nova-compute[72441]: WARNING nova.compute.manager [req-360e9dc7-f65a-46b3-98d5-3aae47cae358 req-5232c86a-0753-4347-9586-d759c86a4df9 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state building and task_state spawning.
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.167s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Cannot resize image /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'migration_context' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Ensure instance console log exists: /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Successfully created port: c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:16 user nova-compute[72441]: INFO nova.compute.manager [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Terminating instance
Aug 09 19:35:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Instance destroyed successfully.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lazy-loading 'resources' on Instance uuid 3e84de40-d220-4cd6-8ef3-a04c7231fa16 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1036900387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-126806307',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn6IYeMd96nC/HkLCWeqjt3nj9VxcvE5MKXvpO83n23Xk5XmyKKsUNIHpCpNfVuuwcZxyTcLjQF4qk3j7RY9tOO7Zsa5OSPOcGTl72Q90ZYkpWi/v+v56ekPIandwKlqw==',key_name='tempest-keypair-506233433',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:34:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='985b7412ae7848a9ac95b7f14a2aa4da',ramdisk_id='',reservation_id='r-10rftg7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-264129131',owner_user_name='tempest-ServerActionsV293TestJSON-264129131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f47342db0cd34582b51a1ce8e024e8a8',uuid=3e84de40-d220-4cd6-8ef3-a04c7231fa16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converting VIF {"id": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "address": "fa:16:3e:df:6a:c2", "network": {"id": "701cd22a-b7f1-49b8-8f8d-ef41bb33adbc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-842812012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "985b7412ae7848a9ac95b7f14a2aa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeb6e35-7f", "ovs_interfaceid": "2eeb6e35-7f61-452f-acd1-492a42fb5499", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_vif [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eeb6e35-7f, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:35:17 user nova-compute[72441]: INFO os_vif [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=2eeb6e35-7f61-452f-acd1-492a42fb5499,network=Network(701cd22a-b7f1-49b8-8f8d-ef41bb33adbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeb6e35-7f')
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OYnErgau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:35:17 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3295fb78-960d-4012-8cb6-483b9dfbe19c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1476aece-f70f-451a-b2e9-aefcb2741dc4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:35:17 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:35:17 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:35:17 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:35:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:35:17 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:35:17 user nova-compute[72441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd (non-flash)
Aug 09 19:35:17 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:35:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90613910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dfe5bf-ebe5-469a-a6a1-6a5c7879f839]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01093624-e153-4fe7-ac4a-d2dc2eb98b8f]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4541194b-5086-47cb-9f0d-d2bf21c6a3e9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609717.3255513, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Resumed (Lifecycle Event)
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance spawned successfully.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Successfully updated port: c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b2201-18da-4d7d-82de-393e5202c121]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf9ddd652-5b6c319ac6025189', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9ddd652', '/dev/disk/by-id/scsi-23562366333313961') {{(pid=83536) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[93728f6d-049c-4ba7-a93b-6d817c1d8d64]: (4, None) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5754af9-ef10-4a02-8f93-ad4912295fad]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609717.326549, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Started (Lifecycle Event)
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:17 user nova-compute[72441]: WARNING nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state building and task_state spawning.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-unplugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-unplugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-unplugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Acquiring lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] No waiting events found dispatching network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:17 user nova-compute[72441]: WARNING nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received unexpected event network-vif-plugged-2eeb6e35-7f61-452f-acd1-492a42fb5499 for instance with vm_state active and task_state deleting.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-changed-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Refreshing instance network info cache due to event network-changed-c484855c-49b5-4ca8-8e4a-4933ab67a57a. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610a44f-462b-4fd5-839e-a9d5568d5d20]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260]
Aug 09 19:35:17 user nova-compute[72441]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd, portal: 172.16.0.220,3260] successful.
Aug 09 19:35:17 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49ef235c-5b35-4e62-9301-54435ccdc0dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ce6d4-1964-427c-a500-84955f5c1d2c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] <== disconnect_volume: return (395ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Deleting instance files /opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16_del
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Deletion of /opt/stack/data/nova/instances/3e84de40-d220-4cd6-8ef3-a04c7231fa16_del complete
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Took 6.62 seconds to build instance.
Aug 09 19:35:17 user nova-compute[72441]: INFO nova.compute.manager [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-57e6e200-4f1c-48cb-bcd9-b41421490006 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.neutron [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance network_info: |[{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Refreshing network info cache for port c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start _get_guest_xml network_info=[{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:35:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:35:17 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'pci_devices' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:35:17 user nova-compute[72441]:   <uuid>c004c872-c398-4e9c-867d-e9d1cddf4735</uuid>
Aug 09 19:35:17 user nova-compute[72441]:   <name>instance-00000028</name>
Aug 09 19:35:17 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:35:17 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:35:17 user nova-compute[72441]:   <metadata>
Aug 09 19:35:17 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:35:17 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:35:17 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1348893918</nova:name>
Aug 09 19:35:17 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:35:17</nova:creationTime>
Aug 09 19:35:17 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:35:17 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:35:17 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:35:17 user nova-compute[72441]:       <nova:owner>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:user uuid="febf31bc22ae4e00a5e7be7c44708626">tempest-AttachVolumeTestJSON-333200942-project-member</nova:user>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:project uuid="bb19329778d94a21828a4d3d61d75217">tempest-AttachVolumeTestJSON-333200942</nova:project>
Aug 09 19:35:17 user nova-compute[72441]:       </nova:owner>
Aug 09 19:35:17 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:35:17 user nova-compute[72441]:       <nova:ports>
Aug 09 19:35:17 user nova-compute[72441]:         <nova:port uuid="c484855c-49b5-4ca8-8e4a-4933ab67a57a">
Aug 09 19:35:17 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:35:17 user nova-compute[72441]:         </nova:port>
Aug 09 19:35:17 user nova-compute[72441]:       </nova:ports>
Aug 09 19:35:17 user nova-compute[72441]:     </nova:instance>
Aug 09 19:35:17 user nova-compute[72441]:   </metadata>
Aug 09 19:35:17 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:35:17 user nova-compute[72441]:     <system>
Aug 09 19:35:17 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:35:17 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:35:17 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:35:17 user nova-compute[72441]:       <entry name="serial">c004c872-c398-4e9c-867d-e9d1cddf4735</entry>
Aug 09 19:35:17 user nova-compute[72441]:       <entry name="uuid">c004c872-c398-4e9c-867d-e9d1cddf4735</entry>
Aug 09 19:35:17 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:35:17 user nova-compute[72441]:     </system>
Aug 09 19:35:17 user nova-compute[72441]:   </sysinfo>
Aug 09 19:35:17 user nova-compute[72441]:   <os>
Aug 09 19:35:17 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:35:17 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:35:17 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:35:17 user nova-compute[72441]:   </os>
Aug 09 19:35:17 user nova-compute[72441]:   <features>
Aug 09 19:35:17 user nova-compute[72441]:     <acpi/>
Aug 09 19:35:17 user nova-compute[72441]:     <apic/>
Aug 09 19:35:17 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:35:17 user nova-compute[72441]:   </features>
Aug 09 19:35:17 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:35:17 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:35:17 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:35:17 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:35:17 user nova-compute[72441]:   </clock>
Aug 09 19:35:17 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:35:17 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:35:17 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:35:17 user nova-compute[72441]:   </cpu>
Aug 09 19:35:17 user nova-compute[72441]:   <devices>
Aug 09 19:35:17 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:35:17 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:35:17 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk"/>
Aug 09 19:35:17 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:35:17 user nova-compute[72441]:     </disk>
Aug 09 19:35:17 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:35:17 user nova-compute[72441]:       <mac address="fa:16:3e:9f:69:22"/>
Aug 09 19:35:17 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:35:17 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:35:17 user nova-compute[72441]:       <target dev="tapc484855c-49"/>
Aug 09 19:35:17 user nova-compute[72441]:     </interface>
Aug 09 19:35:17 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:35:17 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/console.log" append="off"/>
Aug 09 19:35:17 user nova-compute[72441]:     </serial>
Aug 09 19:35:17 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:35:17 user nova-compute[72441]:     <video>
Aug 09 19:35:17 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:35:17 user nova-compute[72441]:     </video>
Aug 09 19:35:17 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:35:17 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:35:17 user nova-compute[72441]:     </rng>
Aug 09 19:35:17 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:35:17 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:35:17 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:35:17 user nova-compute[72441]:     </memballoon>
Aug 09 19:35:17 user nova-compute[72441]:   </devices>
Aug 09 19:35:17 user nova-compute[72441]: </domain>
Aug 09 19:35:17 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG os_vif [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc484855c-49, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc484855c-49, col_values=(('external_ids', {'iface-id': 'c484855c-49b5-4ca8-8e4a-4933ab67a57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:69:22', 'vm-uuid': 'c004c872-c398-4e9c-867d-e9d1cddf4735'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:35:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:17 user nova-compute[72441]: INFO os_vif [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49')
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No VIF found with MAC fa:16:3e:9f:69:22, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updated VIF entry in instance network info cache for port c484855c-49b5-4ca8-8e4a-4933ab67a57a. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9a883671-be18-4c91-bd59-85daae851f74 req-9b476097-634c-4383-baba-345a78768671 service nova] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-f970d132-4190-40db-a6aa-880599be223e req-cbc90f68-1955-491f-8f98-01c18bde8f95 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Received event network-vif-deleted-2eeb6e35-7f61-452f-acd1-492a42fb5499 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:18 user nova-compute[72441]: INFO nova.compute.manager [req-f970d132-4190-40db-a6aa-880599be223e req-cbc90f68-1955-491f-8f98-01c18bde8f95 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Neutron deleted interface 2eeb6e35-7f61-452f-acd1-492a42fb5499; detaching it from the instance and deleting it from the info cache
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.network.neutron [req-f970d132-4190-40db-a6aa-880599be223e req-cbc90f68-1955-491f-8f98-01c18bde8f95 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:18 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Took 0.95 seconds to deallocate network for instance.
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-f970d132-4190-40db-a6aa-880599be223e req-cbc90f68-1955-491f-8f98-01c18bde8f95 service nova] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Detach interface failed, port_id=2eeb6e35-7f61-452f-acd1-492a42fb5499, reason: Instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:35:18 user nova-compute[72441]: INFO nova.compute.manager [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Unrescuing
Aug 09 19:35:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:35:18 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'flavor' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:19 user nova-compute[72441]: INFO nova.compute.manager [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Took 1.07 seconds to detach 1 volumes for instance.
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Deleting volume: 49ef235c-5b35-4e62-9301-54435ccdc0dd {{(pid=72441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-5c610922-a12d-4183-8277-5fa16abc16aa req-73bdc2d4-0e7e-4460-ba3a-eff06963747b service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5c610922-a12d-4183-8277-5fa16abc16aa req-73bdc2d4-0e7e-4460-ba3a-eff06963747b service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5c610922-a12d-4183-8277-5fa16abc16aa req-73bdc2d4-0e7e-4460-ba3a-eff06963747b service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5c610922-a12d-4183-8277-5fa16abc16aa req-73bdc2d4-0e7e-4460-ba3a-eff06963747b service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-5c610922-a12d-4183-8277-5fa16abc16aa req-73bdc2d4-0e7e-4460-ba3a-eff06963747b service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:19 user nova-compute[72441]: WARNING nova.compute.manager [req-5c610922-a12d-4183-8277-5fa16abc16aa req-73bdc2d4-0e7e-4460-ba3a-eff06963747b service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state building and task_state spawning.
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-1cdb1899-9e72-4b35-bfd6-2af1a50f88e9 req-7c0ae6b4-df30-4eff-a6c6-a91dd457bccf service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1cdb1899-9e72-4b35-bfd6-2af1a50f88e9 req-7c0ae6b4-df30-4eff-a6c6-a91dd457bccf service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1cdb1899-9e72-4b35-bfd6-2af1a50f88e9 req-7c0ae6b4-df30-4eff-a6c6-a91dd457bccf service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1cdb1899-9e72-4b35-bfd6-2af1a50f88e9 req-7c0ae6b4-df30-4eff-a6c6-a91dd457bccf service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-1cdb1899-9e72-4b35-bfd6-2af1a50f88e9 req-7c0ae6b4-df30-4eff-a6c6-a91dd457bccf service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:19 user nova-compute[72441]: WARNING nova.compute.manager [req-1cdb1899-9e72-4b35-bfd6-2af1a50f88e9 req-7c0ae6b4-df30-4eff-a6c6-a91dd457bccf service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:35:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance destroyed successfully.
Aug 09 19:35:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:20 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Deleted allocations for instance 3e84de40-d220-4cd6-8ef3-a04c7231fa16
Aug 09 19:35:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c03dd5c8-baf0-4f13-bbfb-56e7067d6613 tempest-ServerActionsV293TestJSON-264129131 tempest-ServerActionsV293TestJSON-264129131-project-member] Lock "3e84de40-d220-4cd6-8ef3-a04c7231fa16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.450s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-d89ace4a-90fd-4e1a-8e4f-aa9cc2931f4c req-7ff35cd2-3c05-498b-a74b-78eb46255140 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d89ace4a-90fd-4e1a-8e4f-aa9cc2931f4c req-7ff35cd2-3c05-498b-a74b-78eb46255140 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d89ace4a-90fd-4e1a-8e4f-aa9cc2931f4c req-7ff35cd2-3c05-498b-a74b-78eb46255140 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d89ace4a-90fd-4e1a-8e4f-aa9cc2931f4c req-7ff35cd2-3c05-498b-a74b-78eb46255140 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-d89ace4a-90fd-4e1a-8e4f-aa9cc2931f4c req-7ff35cd2-3c05-498b-a74b-78eb46255140 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:21 user nova-compute[72441]: WARNING nova.compute.manager [req-d89ace4a-90fd-4e1a-8e4f-aa9cc2931f4c req-7ff35cd2-3c05-498b-a74b-78eb46255140 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state building and task_state spawning.
Aug 09 19:35:21 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609721.9916136, c004c872-c398-4e9c-867d-e9d1cddf4735 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:21 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Resumed (Lifecycle Event)
Aug 09 19:35:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:35:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance spawned successfully.
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-bb6908c4-154e-4edc-9c56-20b5e646486d req-a0b8f4ec-7024-4a8b-8e9f-176e350dd25a service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bb6908c4-154e-4edc-9c56-20b5e646486d req-a0b8f4ec-7024-4a8b-8e9f-176e350dd25a service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bb6908c4-154e-4edc-9c56-20b5e646486d req-a0b8f4ec-7024-4a8b-8e9f-176e350dd25a service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bb6908c4-154e-4edc-9c56-20b5e646486d req-a0b8f4ec-7024-4a8b-8e9f-176e350dd25a service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-bb6908c4-154e-4edc-9c56-20b5e646486d req-a0b8f4ec-7024-4a8b-8e9f-176e350dd25a service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:22 user nova-compute[72441]: WARNING nova.compute.manager [req-bb6908c4-154e-4edc-9c56-20b5e646486d req-a0b8f4ec-7024-4a8b-8e9f-176e350dd25a service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:35:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609721.9942262, c004c872-c398-4e9c-867d-e9d1cddf4735 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Started (Lifecycle Event)
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:35:22 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:35:22 user nova-compute[72441]: INFO nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Took 7.37 seconds to spawn the instance on the hypervisor.
Aug 09 19:35:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:22 user nova-compute[72441]: INFO nova.compute.manager [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Took 8.18 seconds to build instance.
Aug 09 19:35:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2f96a98a-fb27-4395-985b-2c87a89480aa tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.295s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:23 user nova-compute[72441]: INFO nova.compute.manager [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Terminating instance
Aug 09 19:35:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:24 user nova-compute[72441]: WARNING nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:24 user nova-compute[72441]: WARNING nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-vif-unplugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] No waiting events found dispatching network-vif-unplugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-20f67859-4242-439d-9d8a-e912a3281c02 req-98617954-ff19-401a-9734-00816c522d00 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-vif-unplugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 09347414-6629-463e-a3c5-c1a0a09cde71 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609724.4615855, 09347414-6629-463e-a3c5-c1a0a09cde71 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Resumed (Lifecycle Event)
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b837362f-a4a8-4cda-adad-99d092b4fe65 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Instance destroyed successfully.
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'resources' on Instance uuid 14cc7eae-5cdf-4325-871c-14db3f9507e0 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1994242009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1994242009',id=28,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:26:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-x2j28kbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:27:57Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=14cc7eae-5cdf-4325-871c-14db3f9507e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "address": "fa:16:3e:4f:cc:ff", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e194a-bf", "ovs_interfaceid": "714e194a-bfbd-40b0-bab3-c096d61ed0cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG os_vif [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap714e194a-bf, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:35:24 user nova-compute[72441]: INFO os_vif [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=714e194a-bfbd-40b0-bab3-c096d61ed0cb,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e194a-bf')
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Deleting instance files /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0_del
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Deletion of /opt/stack/data/nova/instances/14cc7eae-5cdf-4325-871c-14db3f9507e0_del complete
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609724.4618125, 09347414-6629-463e-a3c5-c1a0a09cde71 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Started (Lifecycle Event)
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 19:35:24 user nova-compute[72441]: INFO nova.compute.manager [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 19:35:24 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:35:24 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:25 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Took 0.66 seconds to deallocate network for instance.
Aug 09 19:35:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-8748c2b8-6606-4960-aaeb-f94146ef7e50 req-ca91efdc-7463-4501-a0c8-0c2f29788334 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-vif-deleted-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:25 user nova-compute[72441]: INFO nova.compute.manager [req-8748c2b8-6606-4960-aaeb-f94146ef7e50 req-ca91efdc-7463-4501-a0c8-0c2f29788334 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Neutron deleted interface 714e194a-bfbd-40b0-bab3-c096d61ed0cb; detaching it from the instance and deleting it from the info cache
Aug 09 19:35:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-8748c2b8-6606-4960-aaeb-f94146ef7e50 req-ca91efdc-7463-4501-a0c8-0c2f29788334 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-8748c2b8-6606-4960-aaeb-f94146ef7e50 req-ca91efdc-7463-4501-a0c8-0c2f29788334 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Detach interface failed, port_id=714e194a-bfbd-40b0-bab3-c096d61ed0cb, reason: Instance 14cc7eae-5cdf-4325-871c-14db3f9507e0 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:35:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:25 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Deleted allocations for instance 14cc7eae-5cdf-4325-871c-14db3f9507e0
Aug 09 19:35:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9096c371-e7d8-4740-bd60-1fca1641b1e9 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-b1f81785-c352-4a00-9dfb-61db5dfde522 req-a28afde9-7c0f-4a90-b677-cc1816dc6773 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received event network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:35:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b1f81785-c352-4a00-9dfb-61db5dfde522 req-a28afde9-7c0f-4a90-b677-cc1816dc6773 service nova] Acquiring lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b1f81785-c352-4a00-9dfb-61db5dfde522 req-a28afde9-7c0f-4a90-b677-cc1816dc6773 service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b1f81785-c352-4a00-9dfb-61db5dfde522 req-a28afde9-7c0f-4a90-b677-cc1816dc6773 service nova] Lock "14cc7eae-5cdf-4325-871c-14db3f9507e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-b1f81785-c352-4a00-9dfb-61db5dfde522 req-a28afde9-7c0f-4a90-b677-cc1816dc6773 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] No waiting events found dispatching network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:35:26 user nova-compute[72441]: WARNING nova.compute.manager [req-b1f81785-c352-4a00-9dfb-61db5dfde522 req-a28afde9-7c0f-4a90-b677-cc1816dc6773 service nova] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Received unexpected event network-vif-plugged-714e194a-bfbd-40b0-bab3-c096d61ed0cb for instance with vm_state deleted and task_state None.
Aug 09 19:35:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:32 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609717.04732, 3e84de40-d220-4cd6-8ef3-a04c7231fa16 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:32 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] VM Stopped (Lifecycle Event)
Aug 09 19:35:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-46308608-9285-406f-8a55-308aa764a884 None None] [instance: 3e84de40-d220-4cd6-8ef3-a04c7231fa16] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:35:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:35:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:35:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:35:38 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7638MB free_disk=25.111827850341797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 98d0d122-7e57-4f77-9581-3447e9672e36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:35:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:35:39 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609724.4491475, 14cc7eae-5cdf-4325-871c-14db3f9507e0 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:35:39 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] VM Stopped (Lifecycle Event)
Aug 09 19:35:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d0eadede-583e-4d56-88b7-44cac91ee027 None None] [instance: 14cc7eae-5cdf-4325-871c-14db3f9507e0] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:35:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:35:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:35:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:35:40 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:35:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:35:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:35:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:35:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:35:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:35:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:14 user nova-compute[72441]: INFO nova.compute.manager [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Terminating instance
Aug 09 19:36:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-63840e38-113e-41bf-b30d-9f228a648f57 req-f1352765-8b79-40d0-be2b-09497367cc4e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-63840e38-113e-41bf-b30d-9f228a648f57 req-f1352765-8b79-40d0-be2b-09497367cc4e service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-63840e38-113e-41bf-b30d-9f228a648f57 req-f1352765-8b79-40d0-be2b-09497367cc4e service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-63840e38-113e-41bf-b30d-9f228a648f57 req-f1352765-8b79-40d0-be2b-09497367cc4e service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-63840e38-113e-41bf-b30d-9f228a648f57 req-f1352765-8b79-40d0-be2b-09497367cc4e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-63840e38-113e-41bf-b30d-9f228a648f57 req-f1352765-8b79-40d0-be2b-09497367cc4e service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-unplugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Instance destroyed successfully.
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'resources' on Instance uuid 4eb07fb7-1056-44f7-a6df-c2d42c64c393 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1759705474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1759705474',id=14,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-hevbummp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:24:11Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=4eb07fb7-1056-44f7-a6df-c2d42c64c393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "address": "fa:16:3e:ba:da:91", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281c4b39-0b", "ovs_interfaceid": "281c4b39-0bff-4f2c-b5ef-80aadcb0a22e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_vif [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap281c4b39-0b, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:15 user nova-compute[72441]: INFO os_vif [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:da:91,bridge_name='br-int',has_traffic_filtering=True,id=281c4b39-0bff-4f2c-b5ef-80aadcb0a22e,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281c4b39-0b')
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLYXDxHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:36:15 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3233b23-d6da-4fee-b56e-855a7292a843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e751381-42b5-41ea-8234-775d9ca2aed5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:36:15 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:36:15 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:36:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 (non-flash)
Aug 09 19:36:15 user nova-compute[72441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:36:15 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:36:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd98478c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632'): ({'sdf'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Removing single pathed devices sdf {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a560b608-29f6-4758-8047-25b6ca73b13f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3312d-3ad7-4def-a4eb-702635c1aaf8]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Flushing IO for device /dev/sdf {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df900a-67eb-4079-8fd3-61982f5bdde8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be98c2-70e2-4ab7-b836-b160d0f11197]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] SCSI volumes sdf have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[462cbb5c-1cfc-48a6-baa8-3f4a10a10885]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f78ded-632e-4273-bbe2-4a47a30e4d0c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260]
Aug 09 19:36:15 user nova-compute[72441]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632, portal: 172.16.0.220,3260] successful.
Aug 09 19:36:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbff22c-817c-48f7-b3d6-0a0daf1fa632 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[082982f3-7cbe-400e-8f28-b9534da0ca56]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] <== disconnect_volume: return (289ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:36:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Deleting instance files /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393_del
Aug 09 19:36:15 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Deletion of /opt/stack/data/nova/instances/4eb07fb7-1056-44f7-a6df-c2d42c64c393_del complete
Aug 09 19:36:15 user nova-compute[72441]: INFO nova.compute.manager [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 09 19:36:15 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:36:15 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:36:15 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Took 0.49 seconds to deallocate network for instance.
Aug 09 19:36:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] Acquiring lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] No waiting events found dispatching network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:36:16 user nova-compute[72441]: WARNING nova.compute.manager [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received unexpected event network-vif-plugged-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e for instance with vm_state active and task_state deleting.
Aug 09 19:36:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-0ab39df6-3120-4f34-a4fd-5af6f4f6293c req-d2415b42-8ff0-4ffe-96ae-47da0cb5981a service nova] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Received event network-vif-deleted-281c4b39-0bff-4f2c-b5ef-80aadcb0a22e {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:16 user nova-compute[72441]: INFO nova.compute.manager [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Took 0.87 seconds to detach 1 volumes for instance.
Aug 09 19:36:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:17 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:36:17 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:36:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:17 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Deleted allocations for instance 4eb07fb7-1056-44f7-a6df-c2d42c64c393
Aug 09 19:36:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3d8abfa0-13ea-4383-9ca9-fd7486d81375 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "4eb07fb7-1056-44f7-a6df-c2d42c64c393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-changed-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Refreshing instance network info cache due to event network-changed-a49642b5-a644-4f8b-bda5-d8aabcb3946c. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] Acquiring lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] Acquired lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG nova.network.neutron [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Refreshing network info cache for port a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG nova.network.neutron [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updated VIF entry in instance network info cache for port a49642b5-a644-4f8b-bda5-d8aabcb3946c. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG nova.network.neutron [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updating instance_info_cache with network_info: [{"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:36:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4360ddf9-fcab-410c-8e3a-76df4bbc511c req-55836fec-c4b7-429b-a8c0-7ae46324ea23 service nova] Releasing lock "refresh_cache-98d0d122-7e57-4f77-9581-3447e9672e36" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609775.0539963, 4eb07fb7-1056-44f7-a6df-c2d42c64c393 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:36:30 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] VM Stopped (Lifecycle Event)
Aug 09 19:36:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8a3aeade-0a08-4943-ac84-3e5080a5b60e None None] [instance: 4eb07fb7-1056-44f7-a6df-c2d42c64c393] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:36:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:36:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7892MB free_disk=25.072246551513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 98d0d122-7e57-4f77-9581-3447e9672e36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 93250686-e205-4920-b8eb-f82ac66fef25 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "93250686-e205-4920-b8eb-f82ac66fef25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.126s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:36:39 user nova-compute[72441]: INFO nova.compute.claims [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Claim successful on node user
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:36:39 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:36:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:36:40 user nova-compute[72441]: INFO nova.virt.block_device [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Booting with volume snapshot 5cf11186-f6ff-47e1-8ae8-6c0fc9debea5 at /dev/vda
Aug 09 19:36:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG nova.policy [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd066b4d22049d0b2129ad1f38ef9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ae81254564eadaf8042330cb1fdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:36:40 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:36:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Successfully created port: 7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:36:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:36:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:36:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:36:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Successfully updated port: 7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquired lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-changed-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Refreshing instance network info cache due to event network-changed-7c02c852-3c4a-4940-930b-40e704b45b68. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] Acquiring lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updating instance_info_cache with network_info: [{"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Releasing lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Instance network_info: |[{"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] Acquired lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:36:42 user nova-compute[72441]: DEBUG nova.network.neutron [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Refreshing network info cache for port 7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:36:43 user nova-compute[72441]: DEBUG nova.network.neutron [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updated VIF entry in instance network info cache for port 7c02c852-3c4a-4940-930b-40e704b45b68. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:36:43 user nova-compute[72441]: DEBUG nova.network.neutron [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updating instance_info_cache with network_info: [{"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:36:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2fe74fb7-21b7-4374-861d-abfdd949ac1c req-1151ecfa-5ca1-4bb3-8bbd-658e0877a659 service nova] Releasing lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG os_brick.utils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be13958-a5a7-4358-bb7e-7273e74357be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a73cb-518a-444e-98c7-64aed5405ee4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e5aeca-4599-44fb-8a16-0946dec056f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f33e2a8-1341-4c9d-998b-251d2bf968e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:36:45 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:36:45 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a548c6-86f9-4c74-9a47-09b0a3827095]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG os_brick.utils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:36:45 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updating existing volume attachment record: 5efcffbb-5edd-4055-a95c-3b1663d15f30 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:36:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:36:54 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Creating image(s)
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Ensure instance console log exists: /opt/stack/data/nova/instances/93250686-e205-4920-b8eb-f82ac66fef25/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Start _get_guest_xml network_info=[{"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T19:36:31Z,direct_url=<?>,disk_format='qcow2',id=ec01f09b-6eb7-48f0-8f11-a7649ee76f1e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1130031531',owner='256ae81254564eadaf8042330cb1fdce',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T19:36:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moPaLSYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93250686-e205-4920-b8eb-f82ac66fef25', 'attached_at': '', 'detached_at': '', 'volume_id': '75a13e20-6cc0-4c62-b8aa-22fca84aa977', 'serial': '75a13e20-6cc0-4c62-b8aa-22fca84aa977'}, 'attachment_id': '5efcffbb-5edd-4055-a95c-3b1663d15f30', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:36:54 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:36:54 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T19:36:31Z,direct_url=<?>,disk_format='qcow2',id=ec01f09b-6eb7-48f0-8f11-a7649ee76f1e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1130031531',owner='256ae81254564eadaf8042330cb1fdce',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T19:36:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moPaLSYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:36:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:36:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.031s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:36:54 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e96da-8cdd-4917-a0d0-7353c41861f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:36:54 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f793d9d-2c64-45fd-9200-d96649d3b587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977] added
Aug 09 19:36:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f773e5-7376-4ffc-9d8d-c57c57ebb534]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3baeb31-2302-498c-8b1c-5e2048013e48]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moPaLSYJ {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moPaLSYJ" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff0ea45-d2bb-4e4b-a5dc-49f64b355191]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moPaLSYJ'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c4d588-5e16-4f07-b96c-6e5cf77847eb]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4ae697-f06c-4faa-9247-28a2baacb06e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:36:54 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:36:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:36:54 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:36:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecdcb8b-ec84-4a06-b4ae-6da4467fa459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260]
Aug 09 19:36:54 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260] successful.
Aug 09 19:36:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a8f34c-89d5-496f-9fd3-591fda6c69f5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1811021-6891-4d77-8537-452b22fd9f2a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:36:54 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:36:54 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:36:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:36:54 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:36:54 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:36:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0cd0f-af0d-4483-b583-e66ef065e510]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:36:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moPaLSYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23962643330326231', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962643330326231', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1472454019',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1472454019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1472454019',id=41,image_ref='ec01f09b-6eb7-48f0-8f11-a7649ee76f1e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlRiDLbBBP5GUaq096Qlhg5nrdngApILn7SJaXxXEH3uLgB4b15CXzf4uKnGnnkQnrjCYE6fUo1+xHlllAxzTNvlZ59me/7W4zI7AF8MoaEYe8c0XfsDPqUXdK2XE/WYQ==',key_name='tempest-keypair-1049378539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-val3irnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1486219267',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=93250686-e205-4920-b8eb-f82ac66fef25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'pci_devices' on Instance uuid 93250686-e205-4920-b8eb-f82ac66fef25 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:36:55 user nova-compute[72441]:   <uuid>93250686-e205-4920-b8eb-f82ac66fef25</uuid>
Aug 09 19:36:55 user nova-compute[72441]:   <name>instance-00000029</name>
Aug 09 19:36:55 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:36:55 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:36:55 user nova-compute[72441]:   <metadata>
Aug 09 19:36:55 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:36:55 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:36:55 user nova-compute[72441]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1472454019</nova:name>
Aug 09 19:36:55 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:36:54</nova:creationTime>
Aug 09 19:36:55 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:36:55 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:36:55 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:36:55 user nova-compute[72441]:       <nova:owner>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:user uuid="0fd066b4d22049d0b2129ad1f38ef9e4">tempest-TestVolumeBootPattern-1486219267-project-member</nova:user>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:project uuid="256ae81254564eadaf8042330cb1fdce">tempest-TestVolumeBootPattern-1486219267</nova:project>
Aug 09 19:36:55 user nova-compute[72441]:       </nova:owner>
Aug 09 19:36:55 user nova-compute[72441]:       <nova:root type="image" uuid="ec01f09b-6eb7-48f0-8f11-a7649ee76f1e"/>
Aug 09 19:36:55 user nova-compute[72441]:       <nova:ports>
Aug 09 19:36:55 user nova-compute[72441]:         <nova:port uuid="7c02c852-3c4a-4940-930b-40e704b45b68">
Aug 09 19:36:55 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:36:55 user nova-compute[72441]:         </nova:port>
Aug 09 19:36:55 user nova-compute[72441]:       </nova:ports>
Aug 09 19:36:55 user nova-compute[72441]:     </nova:instance>
Aug 09 19:36:55 user nova-compute[72441]:   </metadata>
Aug 09 19:36:55 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:36:55 user nova-compute[72441]:     <system>
Aug 09 19:36:55 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:36:55 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:36:55 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:36:55 user nova-compute[72441]:       <entry name="serial">93250686-e205-4920-b8eb-f82ac66fef25</entry>
Aug 09 19:36:55 user nova-compute[72441]:       <entry name="uuid">93250686-e205-4920-b8eb-f82ac66fef25</entry>
Aug 09 19:36:55 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:36:55 user nova-compute[72441]:     </system>
Aug 09 19:36:55 user nova-compute[72441]:   </sysinfo>
Aug 09 19:36:55 user nova-compute[72441]:   <os>
Aug 09 19:36:55 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:36:55 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:36:55 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:36:55 user nova-compute[72441]:   </os>
Aug 09 19:36:55 user nova-compute[72441]:   <features>
Aug 09 19:36:55 user nova-compute[72441]:     <acpi/>
Aug 09 19:36:55 user nova-compute[72441]:     <apic/>
Aug 09 19:36:55 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:36:55 user nova-compute[72441]:   </features>
Aug 09 19:36:55 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:36:55 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:36:55 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:36:55 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:36:55 user nova-compute[72441]:   </clock>
Aug 09 19:36:55 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:36:55 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:36:55 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:36:55 user nova-compute[72441]:   </cpu>
Aug 09 19:36:55 user nova-compute[72441]:   <devices>
Aug 09 19:36:55 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:36:55 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:36:55 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:36:55 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:36:55 user nova-compute[72441]:       <serial>75a13e20-6cc0-4c62-b8aa-22fca84aa977</serial>
Aug 09 19:36:55 user nova-compute[72441]:     </disk>
Aug 09 19:36:55 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:36:55 user nova-compute[72441]:       <mac address="fa:16:3e:62:5a:fd"/>
Aug 09 19:36:55 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:36:55 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:36:55 user nova-compute[72441]:       <target dev="tap7c02c852-3c"/>
Aug 09 19:36:55 user nova-compute[72441]:     </interface>
Aug 09 19:36:55 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:36:55 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/93250686-e205-4920-b8eb-f82ac66fef25/console.log" append="off"/>
Aug 09 19:36:55 user nova-compute[72441]:     </serial>
Aug 09 19:36:55 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:36:55 user nova-compute[72441]:     <video>
Aug 09 19:36:55 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:36:55 user nova-compute[72441]:     </video>
Aug 09 19:36:55 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:36:55 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:36:55 user nova-compute[72441]:     </rng>
Aug 09 19:36:55 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:36:55 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:36:55 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:36:55 user nova-compute[72441]:     </memballoon>
Aug 09 19:36:55 user nova-compute[72441]:   </devices>
Aug 09 19:36:55 user nova-compute[72441]: </domain>
Aug 09 19:36:55 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1472454019',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1472454019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1472454019',id=41,image_ref='ec01f09b-6eb7-48f0-8f11-a7649ee76f1e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlRiDLbBBP5GUaq096Qlhg5nrdngApILn7SJaXxXEH3uLgB4b15CXzf4uKnGnnkQnrjCYE6fUo1+xHlllAxzTNvlZ59me/7W4zI7AF8MoaEYe8c0XfsDPqUXdK2XE/WYQ==',key_name='tempest-keypair-1049378539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-val3irnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1486219267',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=93250686-e205-4920-b8eb-f82ac66fef25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG os_vif [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c02c852-3c, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c02c852-3c, col_values=(('external_ids', {'iface-id': '7c02c852-3c4a-4940-930b-40e704b45b68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:5a:fd', 'vm-uuid': '93250686-e205-4920-b8eb-f82ac66fef25'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:55 user nova-compute[72441]: INFO os_vif [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c')
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:36:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No VIF found with MAC fa:16:3e:62:5a:fd, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-e35a7916-5d86-4b79-bd47-0170c0737f58 req-edf35c11-c8ba-4b22-8e43-fe8e65578350 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e35a7916-5d86-4b79-bd47-0170c0737f58 req-edf35c11-c8ba-4b22-8e43-fe8e65578350 service nova] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e35a7916-5d86-4b79-bd47-0170c0737f58 req-edf35c11-c8ba-4b22-8e43-fe8e65578350 service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e35a7916-5d86-4b79-bd47-0170c0737f58 req-edf35c11-c8ba-4b22-8e43-fe8e65578350 service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-e35a7916-5d86-4b79-bd47-0170c0737f58 req-edf35c11-c8ba-4b22-8e43-fe8e65578350 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] No waiting events found dispatching network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:36:57 user nova-compute[72441]: WARNING nova.compute.manager [req-e35a7916-5d86-4b79-bd47-0170c0737f58 req-edf35c11-c8ba-4b22-8e43-fe8e65578350 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received unexpected event network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 for instance with vm_state building and task_state spawning.
Aug 09 19:36:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609819.526169, 93250686-e205-4920-b8eb-f82ac66fef25 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] VM Resumed (Lifecycle Event)
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Instance spawned successfully.
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609819.5270636, 93250686-e205-4920-b8eb-f82ac66fef25 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] VM Started (Lifecycle Event)
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-5138aa55-21e0-47d2-b59b-e10326c303e2 req-a3ac3ae7-ac5e-47f8-a427-e87f57c19d46 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5138aa55-21e0-47d2-b59b-e10326c303e2 req-a3ac3ae7-ac5e-47f8-a427-e87f57c19d46 service nova] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5138aa55-21e0-47d2-b59b-e10326c303e2 req-a3ac3ae7-ac5e-47f8-a427-e87f57c19d46 service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5138aa55-21e0-47d2-b59b-e10326c303e2 req-a3ac3ae7-ac5e-47f8-a427-e87f57c19d46 service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:36:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-5138aa55-21e0-47d2-b59b-e10326c303e2 req-a3ac3ae7-ac5e-47f8-a427-e87f57c19d46 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] No waiting events found dispatching network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:36:59 user nova-compute[72441]: WARNING nova.compute.manager [req-5138aa55-21e0-47d2-b59b-e10326c303e2 req-a3ac3ae7-ac5e-47f8-a427-e87f57c19d46 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received unexpected event network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 for instance with vm_state building and task_state spawning.
Aug 09 19:36:59 user nova-compute[72441]: INFO nova.compute.manager [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Took 20.27 seconds to build instance.
Aug 09 19:36:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-374141f2-fc26-46ad-9af0-1167d4a3f061 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "93250686-e205-4920-b8eb-f82ac66fef25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.370s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-changed-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing instance network info cache due to event network-changed-77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:37:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:37:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:37:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:37:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updated VIF entry in instance network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:37:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:37:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1416d9f4-0e56-454f-83fd-fa08aeef3caa req-a2299be6-e787-4dfa-ae29-ae5ecf35fef0 service nova] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:37:03 user nova-compute[72441]: INFO nova.compute.manager [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] instance snapshotting
Aug 09 19:37:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Beginning live snapshot process
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json -f qcow2 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvkvkebub/030ec3dfd75d4f87a2f94cbb0ecbda89.delta 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvkvkebub/030ec3dfd75d4f87a2f94cbb0ecbda89.delta 1073741824" returned: 0 in 0.054s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 19:37:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:05 user nova-compute[72441]: INFO nova.compute.manager [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Terminating instance
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 19:37:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvkvkebub/030ec3dfd75d4f87a2f94cbb0ecbda89.delta /opt/stack/data/nova/instances/snapshots/tmpvkvkebub/030ec3dfd75d4f87a2f94cbb0ecbda89 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-changed-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Refreshing instance network info cache due to event network-changed-c484855c-49b5-4ca8-8e4a-4933ab67a57a. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.network.neutron [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Refreshing network info cache for port c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-d3c4e1d8-eef4-4e95-beba-a13446065f88 req-f95c596a-f20c-449c-89d7-e3022a575d19 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-vif-unplugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d3c4e1d8-eef4-4e95-beba-a13446065f88 req-f95c596a-f20c-449c-89d7-e3022a575d19 service nova] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d3c4e1d8-eef4-4e95-beba-a13446065f88 req-f95c596a-f20c-449c-89d7-e3022a575d19 service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d3c4e1d8-eef4-4e95-beba-a13446065f88 req-f95c596a-f20c-449c-89d7-e3022a575d19 service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-d3c4e1d8-eef4-4e95-beba-a13446065f88 req-f95c596a-f20c-449c-89d7-e3022a575d19 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] No waiting events found dispatching network-vif-unplugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-d3c4e1d8-eef4-4e95-beba-a13446065f88 req-f95c596a-f20c-449c-89d7-e3022a575d19 service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-vif-unplugged-67ae7f86-ce60-4d10-92a3-1f844312d497 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Instance destroyed successfully.
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lazy-loading 'resources' on Instance uuid 2ad9a2ce-9bab-4a99-b397-2fb64552efad {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvkvkebub/030ec3dfd75d4f87a2f94cbb0ecbda89.delta /opt/stack/data/nova/instances/snapshots/tmpvkvkebub/030ec3dfd75d4f87a2f94cbb0ecbda89" returned: 0 in 0.711s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Snapshot extracted, beginning image upload
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843939238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843939238',id=1,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d7a9e68495428292b9417ee4b234ad',ramdisk_id='',reservation_id='r-6535syke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:19:21Z,user_data=None,user_id='554ea2267ce94d618fbd7ef211cb7b51',uuid=2ad9a2ce-9bab-4a99-b397-2fb64552efad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converting VIF {"id": "67ae7f86-ce60-4d10-92a3-1f844312d497", "address": "fa:16:3e:b8:49:18", "network": {"id": "413b4125-4d22-4aed-a409-1fd8ca84f727", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1782780094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d7a9e68495428292b9417ee4b234ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ae7f86-ce", "ovs_interfaceid": "67ae7f86-ce60-4d10-92a3-1f844312d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG os_vif [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67ae7f86-ce, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:37:06 user nova-compute[72441]: INFO os_vif [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:49:18,bridge_name='br-int',has_traffic_filtering=True,id=67ae7f86-ce60-4d10-92a3-1f844312d497,network=Network(413b4125-4d22-4aed-a409-1fd8ca84f727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ae7f86-ce')
Aug 09 19:37:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Deleting instance files /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad_del
Aug 09 19:37:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Deletion of /opt/stack/data/nova/instances/2ad9a2ce-9bab-4a99-b397-2fb64552efad_del complete
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updated VIF entry in instance network info cache for port c484855c-49b5-4ca8-8e4a-4933ab67a57a. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dafcbc04-9044-4da7-bdb0-745bb840ec46 req-c3865d69-3445-4ee5-9df7-11a0d70b6942 service nova] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:37:06 user nova-compute[72441]: INFO nova.compute.manager [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 09 19:37:06 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:06 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:37:06 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Took 0.83 seconds to deallocate network for instance.
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:07 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Deleted allocations for instance 2ad9a2ce-9bab-4a99-b397-2fb64552efad
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-02607fd8-61f0-4d03-a0d2-8f3ef251aa58 tempest-ServerBootFromVolumeStableRescueTest-1993502489 tempest-ServerBootFromVolumeStableRescueTest-1993502489-project-member] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-78802eff-942f-41ca-b12e-54c613188855 req-403d4463-651f-499d-8f37-a2143836985a service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-vif-deleted-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-cef0f0d9-13d5-4fcf-9fd3-9a37f3aa4973 req-77511d9e-556d-4d78-a749-1a3056df0a1c service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received event network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cef0f0d9-13d5-4fcf-9fd3-9a37f3aa4973 req-77511d9e-556d-4d78-a749-1a3056df0a1c service nova] Acquiring lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cef0f0d9-13d5-4fcf-9fd3-9a37f3aa4973 req-77511d9e-556d-4d78-a749-1a3056df0a1c service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cef0f0d9-13d5-4fcf-9fd3-9a37f3aa4973 req-77511d9e-556d-4d78-a749-1a3056df0a1c service nova] Lock "2ad9a2ce-9bab-4a99-b397-2fb64552efad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-cef0f0d9-13d5-4fcf-9fd3-9a37f3aa4973 req-77511d9e-556d-4d78-a749-1a3056df0a1c service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] No waiting events found dispatching network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:37:07 user nova-compute[72441]: WARNING nova.compute.manager [req-cef0f0d9-13d5-4fcf-9fd3-9a37f3aa4973 req-77511d9e-556d-4d78-a749-1a3056df0a1c service nova] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Received unexpected event network-vif-plugged-67ae7f86-ce60-4d10-92a3-1f844312d497 for instance with vm_state deleted and task_state None.
Aug 09 19:37:08 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Snapshot image upload complete
Aug 09 19:37:08 user nova-compute[72441]: INFO nova.compute.manager [None req-c58d7f8a-c735-4f94-9224-61b9760999b2 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Took 5.64 seconds to snapshot the instance on the hypervisor.
Aug 09 19:37:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:09 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:37:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.171s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:10 user nova-compute[72441]: INFO nova.compute.manager [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Attaching volume aaa5cd57-c2b9-44af-b142-ffb570195aa6 to /dev/vdb
Aug 09 19:37:10 user nova-compute[72441]: DEBUG os_brick.utils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3530de4-248a-43b9-a566-14bde59334c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[94731c4a-2610-4790-85dc-1b4024d8482c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6365d8-f3f9-4498-9b00-506dfed01fab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470ee73-a022-4047-af92-e263b00769d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:37:10 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95252c0-d567-4254-8c23-485459b35467]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG os_brick.utils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating existing volume attachment record: e5884234-567b-4d92-86fa-0b92faaee889 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing instance network info cache due to event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:37:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:11 user nova-compute[72441]: INFO nova.compute.manager [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Detaching volume 0607edaa-bdbe-4eda-b613-d4dedaf250fd
Aug 09 19:37:11 user nova-compute[72441]: INFO nova.virt.block_device [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Attempting to driver detach volume 0607edaa-bdbe-4eda-b613-d4dedaf250fd from mountpoint /dev/vdb
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Attempting to detach device vdb from instance 09347414-6629-463e-a3c5-c1a0a09cde71 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:37:11 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:37:11 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:37:11 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:37:11 user nova-compute[72441]:   <serial>0607edaa-bdbe-4eda-b613-d4dedaf250fd</serial>
Aug 09 19:37:11 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:37:11 user nova-compute[72441]: </disk>
Aug 09 19:37:11 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:37:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully detached device vdb from instance 09347414-6629-463e-a3c5-c1a0a09cde71 from the persistent domain config.
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09347414-6629-463e-a3c5-c1a0a09cde71 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:37:11 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:37:11 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:37:11 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:37:11 user nova-compute[72441]:   <serial>0607edaa-bdbe-4eda-b613-d4dedaf250fd</serial>
Aug 09 19:37:11 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:37:11 user nova-compute[72441]: </disk>
Aug 09 19:37:11 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updated VIF entry in instance network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-61b502bd-d93d-4b46-b3a3-1fc8065eee88 req-41b73494-8d67-4fb0-9435-32303e0c859d service nova] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691609831.8228106, 09347414-6629-463e-a3c5-c1a0a09cde71 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:37:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully detached device vdb from instance 09347414-6629-463e-a3c5-c1a0a09cde71 from the live domain config.
Aug 09 19:37:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VufibaZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:37:11 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63411018-b989-46c6-9e05-aac5e5198cbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef4c104-7026-492b-b910-6828fe233fc9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:37:11 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:37:11 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:37:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd (non-flash)
Aug 09 19:37:11 user nova-compute[72441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:37:11 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:37:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9056d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4bdf9-363a-4a64-a3ab-9a1a97251768]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7aa8d7-2ece-4c16-a221-3c2797407f09]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88412e37-0fe1-40d3-b85a-7523b5305d93]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:37:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[846b7eaa-a619-4ab1-8d50-882a1ad5c6a9]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67b045-b360-42d0-a268-2bae2f1bf54e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7921acb-c32c-4cb6-b735-6b646b3adcf1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260]
Aug 09 19:37:12 user nova-compute[72441]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd, portal: 172.16.0.220,3260] successful.
Aug 09 19:37:12 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0607edaa-bdbe-4eda-b613-d4dedaf250fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73facd48-4839-4236-82fb-19700d8e74b4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] <== disconnect_volume: return (308ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing instance network info cache due to event network-changed-c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] Acquiring lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] Acquired lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Refreshing network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:37:12 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'flavor' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:37:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7260c4ad-fb06-48a3-998a-4852ce2bcdb7 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updated VIF entry in instance network info cache for port c803b73f-1362-4ea0-93d9-8f380651fd30. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:37:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [{"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:37:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-f4b7bddc-d8bf-4213-b169-dc01a3f029eb req-077600f9-3466-49bc-846b-8848d8b0da21 service nova] Releasing lock "refresh_cache-09347414-6629-463e-a3c5-c1a0a09cde71" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:37:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:37:19 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:37:19 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:37:19 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17aba09-114c-49ed-b90a-5bc597149c34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:37:19 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3521e8-7e8b-46c6-a8a0-33d8260e3f8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6] added
Aug 09 19:37:19 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[294b5195-60c1-4ee2-99d4-d48a32070faf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b18c48-5081-4933-bc21-bc029f4b904b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBVbMpkc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBVbMpkc" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d12264-1d52-4418-970a-9033a5c7c351]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RBVbMpkc'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7988f-c30c-4cf0-b95c-709442edcc74]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[81183ac4-ff9f-45d2-9c92-d1804224bd3a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0da7b-e04e-417e-85b6-8b362c3f458a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]
Aug 09 19:37:19 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.
Aug 09 19:37:19 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[435ed021-db73-4169-bc1e-efbf30983b8c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2860b07f-f816-47bf-9d9b-4e4960b57e78]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:37:19 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7941301-23bf-4e00-8df6-14edfdfee080]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:37:19 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26461346433663933', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461346433663933', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:37:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:37:20 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:37:20 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:37:20 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:37:20 user nova-compute[72441]:   <serial>aaa5cd57-c2b9-44af-b142-ffb570195aa6</serial>
Aug 09 19:37:20 user nova-compute[72441]: </disk>
Aug 09 19:37:20 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609825.998349, 2ad9a2ce-9bab-4a99-b397-2fb64552efad => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:37:21 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] VM Stopped (Lifecycle Event)
Aug 09 19:37:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c119cbac-6ae7-4945-abca-b2290480d262 None None] [instance: 2ad9a2ce-9bab-4a99-b397-2fb64552efad] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No VIF found with MAC fa:16:3e:9f:69:22, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ed41f63f-fc3c-4e9a-beb3-f475276e0f60 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.053s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72441) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG nova.objects.instance [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9813c97-b34f-484b-beee-82bacb087a11 req-be0bdf06-6809-4891-bf76-8fb2b3cdd9fc service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9813c97-b34f-484b-beee-82bacb087a11 req-be0bdf06-6809-4891-bf76-8fb2b3cdd9fc service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9813c97-b34f-484b-beee-82bacb087a11 req-be0bdf06-6809-4891-bf76-8fb2b3cdd9fc service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d9813c97-b34f-484b-beee-82bacb087a11 req-be0bdf06-6809-4891-bf76-8fb2b3cdd9fc service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-d9813c97-b34f-484b-beee-82bacb087a11 req-be0bdf06-6809-4891-bf76-8fb2b3cdd9fc service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:37:22 user nova-compute[72441]: WARNING nova.compute.manager [req-d9813c97-b34f-484b-beee-82bacb087a11 req-be0bdf06-6809-4891-bf76-8fb2b3cdd9fc service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state active and task_state powering-off.
Aug 09 19:37:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance destroyed successfully.
Aug 09 19:37:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:37:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-26bd22f6-f6c7-4bb6-a79d-08d2d06382e8 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.898s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-dcf2e97b-45d2-4ace-9970-7381b75e68e8 req-b0468536-f2dd-411b-beb9-966834353e13 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:37:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dcf2e97b-45d2-4ace-9970-7381b75e68e8 req-b0468536-f2dd-411b-beb9-966834353e13 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dcf2e97b-45d2-4ace-9970-7381b75e68e8 req-b0468536-f2dd-411b-beb9-966834353e13 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-dcf2e97b-45d2-4ace-9970-7381b75e68e8 req-b0468536-f2dd-411b-beb9-966834353e13 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-dcf2e97b-45d2-4ace-9970-7381b75e68e8 req-b0468536-f2dd-411b-beb9-966834353e13 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:37:24 user nova-compute[72441]: WARNING nova.compute.manager [req-dcf2e97b-45d2-4ace-9970-7381b75e68e8 req-b0468536-f2dd-411b-beb9-966834353e13 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state stopped and task_state None.
Aug 09 19:37:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609843.0018876, c004c872-c398-4e9c-867d-e9d1cddf4735 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:37:38 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Stopped (Lifecycle Event)
Aug 09 19:37:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-80ed4db6-62be-4135-8312-d78e316cef9e None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-80ed4db6-62be-4135-8312-d78e316cef9e None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:38 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:37:40 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:37:40 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=7968MB free_disk=25.144718170166016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 09347414-6629-463e-a3c5-c1a0a09cde71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 98d0d122-7e57-4f77-9581-3447e9672e36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 93250686-e205-4920-b8eb-f82ac66fef25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:37:40 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:37:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:41 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:37:41 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:37:41 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:37:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:37:42 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:37:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [{"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:37:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-e30cf305-f264-4aab-a4cf-f555a57e8db3" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:37:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:37:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:37:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:37:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:37:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:01 user nova-compute[72441]: INFO nova.compute.manager [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Terminating instance
Aug 09 19:38:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-6ab1de12-b79d-4410-8a67-2699a3d6ea19 req-4f20671a-32f0-4554-b8b2-dcaefb14f838 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6ab1de12-b79d-4410-8a67-2699a3d6ea19 req-4f20671a-32f0-4554-b8b2-dcaefb14f838 service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6ab1de12-b79d-4410-8a67-2699a3d6ea19 req-4f20671a-32f0-4554-b8b2-dcaefb14f838 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6ab1de12-b79d-4410-8a67-2699a3d6ea19 req-4f20671a-32f0-4554-b8b2-dcaefb14f838 service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-6ab1de12-b79d-4410-8a67-2699a3d6ea19 req-4f20671a-32f0-4554-b8b2-dcaefb14f838 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-6ab1de12-b79d-4410-8a67-2699a3d6ea19 req-4f20671a-32f0-4554-b8b2-dcaefb14f838 service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-unplugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:02 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Instance destroyed successfully.
Aug 09 19:38:02 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'resources' on Instance uuid 09347414-6629-463e-a3c5-c1a0a09cde71 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152882460',display_name='tempest-ServerRescueNegativeTestJSON-server-152882460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152882460',id=35,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHiNOr7xUPGpClsjxDVaXRr3F1M5nVTuSVSoSSB8LlY/Btu8dgSl6QeUB8jA8J5sf1Cldb9evi6OA97b9SfAu4lCtRA0nPxbfFRZc/7SaTBJCx7ecA5AbO5/G+WWVyuYA==',key_name='tempest-keypair-1212364424',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-9i70dhuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=09347414-6629-463e-a3c5-c1a0a09cde71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "c803b73f-1362-4ea0-93d9-8f380651fd30", "address": "fa:16:3e:c2:34:f0", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803b73f-13", "ovs_interfaceid": "c803b73f-1362-4ea0-93d9-8f380651fd30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG os_vif [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc803b73f-13, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:02 user nova-compute[72441]: INFO os_vif [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:34:f0,bridge_name='br-int',has_traffic_filtering=True,id=c803b73f-1362-4ea0-93d9-8f380651fd30,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc803b73f-13')
Aug 09 19:38:02 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Deleting instance files /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71_del
Aug 09 19:38:02 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Deletion of /opt/stack/data/nova/instances/09347414-6629-463e-a3c5-c1a0a09cde71_del complete
Aug 09 19:38:02 user nova-compute[72441]: INFO nova.compute.manager [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 19:38:02 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:38:02 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:38:03 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Took 1.10 seconds to deallocate network for instance.
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-43e69bf0-15c8-46e2-9bbe-00662d6753e3 req-d3b728ae-cf22-4d04-af73-35bed2b0945c service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-deleted-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:03 user nova-compute[72441]: INFO nova.compute.manager [req-43e69bf0-15c8-46e2-9bbe-00662d6753e3 req-d3b728ae-cf22-4d04-af73-35bed2b0945c service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Neutron deleted interface c803b73f-1362-4ea0-93d9-8f380651fd30; detaching it from the instance and deleting it from the info cache
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.network.neutron [req-43e69bf0-15c8-46e2-9bbe-00662d6753e3 req-d3b728ae-cf22-4d04-af73-35bed2b0945c service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-43e69bf0-15c8-46e2-9bbe-00662d6753e3 req-d3b728ae-cf22-4d04-af73-35bed2b0945c service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Detach interface failed, port_id=c803b73f-1362-4ea0-93d9-8f380651fd30, reason: Instance 09347414-6629-463e-a3c5-c1a0a09cde71 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-4bd27dbf-de39-49ca-9917-4b6caff74427 req-62789333-c863-4ed1-8e6e-a3264192d09d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4bd27dbf-de39-49ca-9917-4b6caff74427 req-62789333-c863-4ed1-8e6e-a3264192d09d service nova] Acquiring lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4bd27dbf-de39-49ca-9917-4b6caff74427 req-62789333-c863-4ed1-8e6e-a3264192d09d service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4bd27dbf-de39-49ca-9917-4b6caff74427 req-62789333-c863-4ed1-8e6e-a3264192d09d service nova] Lock "09347414-6629-463e-a3c5-c1a0a09cde71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-4bd27dbf-de39-49ca-9917-4b6caff74427 req-62789333-c863-4ed1-8e6e-a3264192d09d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] No waiting events found dispatching network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:38:03 user nova-compute[72441]: WARNING nova.compute.manager [req-4bd27dbf-de39-49ca-9917-4b6caff74427 req-62789333-c863-4ed1-8e6e-a3264192d09d service nova] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Received unexpected event network-vif-plugged-c803b73f-1362-4ea0-93d9-8f380651fd30 for instance with vm_state deleted and task_state None.
Aug 09 19:38:04 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Deleted allocations for instance 09347414-6629-463e-a3c5-c1a0a09cde71
Aug 09 19:38:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2d22ed47-8abd-490c-bd70-828eeb9a8534 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "09347414-6629-463e-a3c5-c1a0a09cde71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:17 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609882.3513432, 09347414-6629-463e-a3c5-c1a0a09cde71 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:38:17 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] VM Stopped (Lifecycle Event)
Aug 09 19:38:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8d91b9b5-3df7-480e-aa10-885cae8df134 None None] [instance: 09347414-6629-463e-a3c5-c1a0a09cde71] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:38:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:38:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:38:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:38:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:38:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-changed-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Refreshing instance network info cache due to event network-changed-7c02c852-3c4a-4940-930b-40e704b45b68. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:38:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] Acquiring lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:38:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] Acquired lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:38:30 user nova-compute[72441]: DEBUG nova.network.neutron [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Refreshing network info cache for port 7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "93250686-e205-4920-b8eb-f82ac66fef25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:31 user nova-compute[72441]: INFO nova.compute.manager [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Terminating instance
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.network.neutron [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updated VIF entry in instance network info cache for port 7c02c852-3c4a-4940-930b-40e704b45b68. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.network.neutron [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updating instance_info_cache with network_info: [{"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a0dbbf18-c262-49b9-bf94-2e4fc98e42a7 req-e36ec3d0-c48c-4205-852a-a33cdf423332 service nova] Releasing lock "refresh_cache-93250686-e205-4920-b8eb-f82ac66fef25" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-b8a7301c-b043-4327-b098-bcc716dc9cdd req-ce370957-6bad-4099-8214-2fe0ece33e4b service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-vif-unplugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b8a7301c-b043-4327-b098-bcc716dc9cdd req-ce370957-6bad-4099-8214-2fe0ece33e4b service nova] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b8a7301c-b043-4327-b098-bcc716dc9cdd req-ce370957-6bad-4099-8214-2fe0ece33e4b service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b8a7301c-b043-4327-b098-bcc716dc9cdd req-ce370957-6bad-4099-8214-2fe0ece33e4b service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-b8a7301c-b043-4327-b098-bcc716dc9cdd req-ce370957-6bad-4099-8214-2fe0ece33e4b service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] No waiting events found dispatching network-vif-unplugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-b8a7301c-b043-4327-b098-bcc716dc9cdd req-ce370957-6bad-4099-8214-2fe0ece33e4b service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-vif-unplugged-7c02c852-3c4a-4940-930b-40e704b45b68 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Instance destroyed successfully.
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'resources' on Instance uuid 93250686-e205-4920-b8eb-f82ac66fef25 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1472454019',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1472454019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1472454019',id=41,image_ref='ec01f09b-6eb7-48f0-8f11-a7649ee76f1e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlRiDLbBBP5GUaq096Qlhg5nrdngApILn7SJaXxXEH3uLgB4b15CXzf4uKnGnnkQnrjCYE6fUo1+xHlllAxzTNvlZ59me/7W4zI7AF8MoaEYe8c0XfsDPqUXdK2XE/WYQ==',key_name='tempest-keypair-1049378539',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:36:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-val3irnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1486219267',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=93250686-e205-4920-b8eb-f82ac66fef25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "7c02c852-3c4a-4940-930b-40e704b45b68", "address": "fa:16:3e:62:5a:fd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c02c852-3c", "ovs_interfaceid": "7c02c852-3c4a-4940-930b-40e704b45b68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG os_vif [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c02c852-3c, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:32 user nova-compute[72441]: INFO os_vif [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5a:fd,bridge_name='br-int',has_traffic_filtering=True,id=7c02c852-3c4a-4940-930b-40e704b45b68,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c02c852-3c')
Aug 09 19:38:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moPaLSYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:38:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279b5be-8562-45a3-882a-ee5b8fd9a7c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d10bfee-b0b8-4597-bad6-c7d856445e03]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:38:32 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:38:32 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:38:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:38:32 user nova-compute[72441]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 (non-flash)
Aug 09 19:38:32 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:38:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9056eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a124a16-d568-4828-a227-a7ea52ddd40d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5eb8b1-6e80-4be3-a356-93ac325225d7]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c10eb9c-4d3e-4776-bde5-7cc3e0898c0f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1586922d-3fa7-4448-a3e0-5d2e3aae213a]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_da4f6fa', '/dev/disk/by-id/scsi-1SCST_BIOda4f6fa-9bd302b1907077d7', '/dev/disk/by-id/scsi-23962643330326231') {{(pid=83536) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfc2854-0dc6-49d2-99bd-11b7bba38fa2]: (4, None) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa28ac-d1cc-4c2d-a101-cb809d1ada3e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955ec58-cef9-4a47-a2ac-c53f532b64c7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260]
Aug 09 19:38:32 user nova-compute[72441]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977, portal: 172.16.0.220,3260] successful.
Aug 09 19:38:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a13e20-6cc0-4c62-b8aa-22fca84aa977 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b552d5-a0be-4cc0-9494-b6572bb497ab]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== disconnect_volume: return (339ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:38:32 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Deleting instance files /opt/stack/data/nova/instances/93250686-e205-4920-b8eb-f82ac66fef25_del
Aug 09 19:38:32 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Deletion of /opt/stack/data/nova/instances/93250686-e205-4920-b8eb-f82ac66fef25_del complete
Aug 09 19:38:32 user nova-compute[72441]: INFO nova.compute.manager [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 09 19:38:32 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:38:32 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:38:33 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Took 1.12 seconds to deallocate network for instance.
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-22f031e6-1d91-40aa-b1e8-7526a81023b8 req-c857fd19-3f47-40f6-a6b9-4164b2222ffe service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-vif-deleted-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:33 user nova-compute[72441]: INFO nova.compute.manager [req-22f031e6-1d91-40aa-b1e8-7526a81023b8 req-c857fd19-3f47-40f6-a6b9-4164b2222ffe service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Neutron deleted interface 7c02c852-3c4a-4940-930b-40e704b45b68; detaching it from the instance and deleting it from the info cache
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-22f031e6-1d91-40aa-b1e8-7526a81023b8 req-c857fd19-3f47-40f6-a6b9-4164b2222ffe service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-22f031e6-1d91-40aa-b1e8-7526a81023b8 req-c857fd19-3f47-40f6-a6b9-4164b2222ffe service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Detach interface failed, port_id=7c02c852-3c4a-4940-930b-40e704b45b68, reason: Instance 93250686-e205-4920-b8eb-f82ac66fef25 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-b1b5c0ed-da0f-41a9-a8a0-04ff49657587 req-7bb1a7ac-1b95-44cf-a55c-7b59964dde40 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received event network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b1b5c0ed-da0f-41a9-a8a0-04ff49657587 req-7bb1a7ac-1b95-44cf-a55c-7b59964dde40 service nova] Acquiring lock "93250686-e205-4920-b8eb-f82ac66fef25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b1b5c0ed-da0f-41a9-a8a0-04ff49657587 req-7bb1a7ac-1b95-44cf-a55c-7b59964dde40 service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b1b5c0ed-da0f-41a9-a8a0-04ff49657587 req-7bb1a7ac-1b95-44cf-a55c-7b59964dde40 service nova] Lock "93250686-e205-4920-b8eb-f82ac66fef25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-b1b5c0ed-da0f-41a9-a8a0-04ff49657587 req-7bb1a7ac-1b95-44cf-a55c-7b59964dde40 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] No waiting events found dispatching network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:38:33 user nova-compute[72441]: WARNING nova.compute.manager [req-b1b5c0ed-da0f-41a9-a8a0-04ff49657587 req-7bb1a7ac-1b95-44cf-a55c-7b59964dde40 service nova] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Received unexpected event network-vif-plugged-7c02c852-3c4a-4940-930b-40e704b45b68 for instance with vm_state active and task_state deleting.
Aug 09 19:38:34 user nova-compute[72441]: INFO nova.compute.manager [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Took 0.79 seconds to detach 1 volumes for instance.
Aug 09 19:38:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Deleting volume: 75a13e20-6cc0-4c62-b8aa-22fca84aa977 {{(pid=72441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:38:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:34 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Deleted allocations for instance 93250686-e205-4920-b8eb-f82ac66fef25
Aug 09 19:38:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-e2ccb704-1c6f-4c54-b840-78a604e1e4cf tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "93250686-e205-4920-b8eb-f82ac66fef25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.759s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:38:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:38:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:38:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:38:40 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [{"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-d643ae7c-ca03-4921-b6d2-66433a539cde" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:43 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:38:43 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=25.16866683959961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d643ae7c-ca03-4921-b6d2-66433a539cde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 98d0d122-7e57-4f77-9581-3447e9672e36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:38:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:38:46 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609911.9744358, 93250686-e205-4920-b8eb-f82ac66fef25 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:38:46 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] VM Stopped (Lifecycle Event)
Aug 09 19:38:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5f67e975-4dab-4eb1-a83f-0ed4f4fd0476 None None] [instance: 93250686-e205-4920-b8eb-f82ac66fef25] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:38:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:38:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:38:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:38:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:38:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:38:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'flavor' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:38:54 user nova-compute[72441]: INFO nova.compute.manager [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Attaching volume 36f6cfba-a6d6-490c-913f-e93ead9ea030 to /dev/vdb
Aug 09 19:38:54 user nova-compute[72441]: DEBUG os_brick.utils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31d4a3b-dc8e-4122-8f84-0773cbc99ed8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0258b-8121-4ea2-bc2c-11eb3570498b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3939b-2ee6-4d75-ab32-8f11eccb00b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb0803-fafc-452e-b3ab-b6172d585fb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:38:54 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:38:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0167f8-a3d7-4b7b-9a30-6e2d66f02167]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG os_brick.utils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:38:54 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating existing volume attachment record: c3060c58-7efa-490d-873e-a99728c2963c {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:38:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlcIUzVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:39:03 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:03 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:03 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c35b07-55d8-47fd-a624-071dc74174f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:39:03 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0052d60d-6029-4f84-a8da-c51e57d375a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030] added
Aug 09 19:39:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519b70b-99d8-4339-9686-01a7598668ce]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6433d8b4-4749-429d-bb43-593f2c4339a5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlcIUzVg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlcIUzVg" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e57e8-065c-498a-80dd-4c8c84906ce5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jlcIUzVg'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d44c86-f8bb-44d5-ac42-dbb4dd03c2f5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d232322-5186-4721-afe2-ffe8be49241e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c7be30-374a-49f3-89f9-af4f67c5d6fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260]
Aug 09 19:39:03 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260] successful.
Aug 09 19:39:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da117b-d9c3-4ba9-8eb4-4d97334488a9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf3f12-6331-4c5c-ab08-ff3fb5d51a51]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:03 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[062780a3-f576-44a2-af40-c9c31bad64dc]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:39:03 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlcIUzVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:39:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:04 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23731633730323139', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:39:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633730323139', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:39:04 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'flavor' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:04 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:39:04 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:39:04 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:39:04 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:39:04 user nova-compute[72441]:   <serial>36f6cfba-a6d6-490c-913f-e93ead9ea030</serial>
Aug 09 19:39:04 user nova-compute[72441]: </disk>
Aug 09 19:39:04 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:39:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:39:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:39:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No VIF found with MAC fa:16:3e:e3:6e:3d, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:39:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b2a3cef-fe9f-467b-94e9-812f6ecea2d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.787s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:06 user nova-compute[72441]: INFO nova.compute.manager [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Rescuing
Aug 09 19:39:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:39:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:39:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-1fedc90b-12a3-4b2f-88b5-4dac119ec861 req-3df0dbcd-9f67-4ca8-8777-e48deac69be4 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fedc90b-12a3-4b2f-88b5-4dac119ec861 req-3df0dbcd-9f67-4ca8-8777-e48deac69be4 service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fedc90b-12a3-4b2f-88b5-4dac119ec861 req-3df0dbcd-9f67-4ca8-8777-e48deac69be4 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1fedc90b-12a3-4b2f-88b5-4dac119ec861 req-3df0dbcd-9f67-4ca8-8777-e48deac69be4 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-1fedc90b-12a3-4b2f-88b5-4dac119ec861 req-3df0dbcd-9f67-4ca8-8777-e48deac69be4 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:07 user nova-compute[72441]: WARNING nova.compute.manager [req-1fedc90b-12a3-4b2f-88b5-4dac119ec861 req-3df0dbcd-9f67-4ca8-8777-e48deac69be4 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state active and task_state rescuing.
Aug 09 19:39:08 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance destroyed successfully.
Aug 09 19:39:08 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Attempting a stable device rescue
Aug 09 19:39:08 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 19:39:08 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance directory exists: not creating {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 19:39:08 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Creating image(s)
Aug 09 19:39:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:08 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "7fb1ed71b899a65fa9f5f7a66d24160384cbea9e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "7fb1ed71b899a65fa9f5f7a66d24160384cbea9e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.part --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:09 user nova-compute[72441]: INFO nova.compute.manager [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Terminating instance
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.virt.images [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] 3e92b817-7b1b-4d2b-8b01-d6733b5280ff was qcow2, converting to raw {{(pid=72441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.privsep.utils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.part /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.converted {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:09 user nova-compute[72441]: WARNING nova.compute.manager [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state active and task_state rescuing.
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-unplugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-unplugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-a54a8a5e-cd49-4651-876c-e680fd7e1295 req-5892f340-3366-43b6-874d-3838160e106c service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-unplugged-18515de4-95d3-463f-a469-61abac987981 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.part /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.converted" returned: 0 in 0.518s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.converted --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "7fb1ed71b899a65fa9f5f7a66d24160384cbea9e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.783s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "7fb1ed71b899a65fa9f5f7a66d24160384cbea9e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "7fb1ed71b899a65fa9f5f7a66d24160384cbea9e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Instance destroyed successfully.
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'resources' on Instance uuid d643ae7c-ca03-4921-b6d2-66433a539cde {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2124327960',display_name='tempest-ServerRescueNegativeTestJSON-server-2124327960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2124327960',id=21,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:24:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-k02t4a5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:24:44Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=d643ae7c-ca03-4921-b6d2-66433a539cde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "18515de4-95d3-463f-a469-61abac987981", "address": "fa:16:3e:48:0c:cb", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18515de4-95", "ovs_interfaceid": "18515de4-95d3-463f-a469-61abac987981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_vif [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18515de4-95, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:10 user nova-compute[72441]: INFO os_vif [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0c:cb,bridge_name='br-int',has_traffic_filtering=True,id=18515de4-95d3-463f-a469-61abac987981,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18515de4-95')
Aug 09 19:39:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Deleting instance files /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde_del
Aug 09 19:39:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Deletion of /opt/stack/data/nova/instances/d643ae7c-ca03-4921-b6d2-66433a539cde_del complete
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e,backing_fmt=raw /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e,backing_fmt=raw /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue" returned: 0 in 0.051s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "7fb1ed71b899a65fa9f5f7a66d24160384cbea9e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'migration_context' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Start _get_guest_xml network_info=[{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "vif_mac": "fa:16:3e:e3:6e:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3e92b817-7b1b-4d2b-8b01-d6733b5280ff', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlcIUzVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1df1084d-ed05-4f3f-aad5-f8d57be3b0f6', 'attached_at': '', 'detached_at': '', 'volume_id': '36f6cfba-a6d6-490c-913f-e93ead9ea030', 'serial': '36f6cfba-a6d6-490c-913f-e93ead9ea030'}, 'attachment_id': 'c3060c58-7efa-490d-873e-a99728c2963c', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'resources' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:10 user nova-compute[72441]: INFO nova.compute.manager [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'numa_topology' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:39:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlcIUzVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:39:10 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:10 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:10 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c394f5b-070b-40ea-bfa5-97e7eabb3a07]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jlcIUzVg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 19:39:10 user nova-compute[72441]: node.name = iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030
Aug 09 19:39:10 user nova-compute[72441]: node.tpgt = -1
Aug 09 19:39:10 user nova-compute[72441]: node.startup = automatic
Aug 09 19:39:10 user nova-compute[72441]: node.leading_login = No
Aug 09 19:39:10 user nova-compute[72441]: iface.iscsi_ifacename = default
Aug 09 19:39:10 user nova-compute[72441]: iface.net_ifacename = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.ipaddress = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.prefix_len = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.hwaddress = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.transport_name = tcp
Aug 09 19:39:10 user nova-compute[72441]: iface.initiatorname = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.vlan_id = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.vlan_priority = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.vlan_state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.iface_num = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.mtu = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.port = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.bootproto = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.subnet_mask = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.gateway = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_alt_client_id = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_dns = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_learn_iqn = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_vendor_id_state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_vendor_id = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.dhcp_slp_da = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.fragmentation = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.gratuitous_arp = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.incoming_forwarding = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.tos_state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.tos = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.ttl = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.delayed_ack = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.tcp_nagle = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.tcp_wsf_state = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.tcp_wsf = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.tcp_timer_scale = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.tcp_timestamp = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.redirect = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.def_task_mgmt_timeout = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.header_digest = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.data_digest = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.immediate_data = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.initial_r2t = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.data_seq_inorder = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.data_pdu_inorder = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.erl = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.max_receive_data_len = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.first_burst_len = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.max_outstanding_r2t = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.max_burst_len = 0
Aug 09 19:39:10 user nova-compute[72441]: iface.chap_auth = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.bidi_chap = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.strict_login_compliance = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.discovery_auth = <empty>
Aug 09 19:39:10 user nova-compute[72441]: iface.discovery_logout = <empty>
Aug 09 19:39:10 user nova-compute[72441]: node.discovery_address = <empty>
Aug 09 19:39:10 user nova-compute[72441]: node.discovery_port = 0
Aug 09 19:39:10 user nova-compute[72441]: node.discovery_type = static
Aug 09 19:39:10 user nova-compute[72441]: node.session.initial_cmdsn = 0
Aug 09 19:39:10 user nova-compute[72441]: node.session.initial_login_retry_max = 8
Aug 09 19:39:10 user nova-compute[72441]: node.session.xmit_thread_priority = -20
Aug 09 19:39:10 user nova-compute[72441]: node.session.cmds_max = 128
Aug 09 19:39:10 user nova-compute[72441]: node.session.queue_depth = 32
Aug 09 19:39:10 user nova-compute[72441]: node.session.nr_sessions = 1
Aug 09 19:39:10 user nova-compute[72441]: node.session.auth.authmethod = CHAP
Aug 09 19:39:10 user nova-compute[72441]: node.session.auth.username = jlcIUzVg
Aug 09 19:39:10 user nova-compute[72441]: node.session.auth.password = ***
Aug 09 19:39:10 user nova-compute[72441]: node.session.auth.username_in = <empty>
Aug 09 19:39:10 user nova-compute[72441]: node.session.auth.password_in = <empty>
Aug 09 19:39:10 user nova-compute[72441]: node.session.auth.chap_algs = MD5
Aug 09 19:39:10 user nova-compute[72441]: node.session.timeo.replacement_timeout = 120
Aug 09 19:39:10 user nova-compute[72441]: node.session.err_timeo.abort_timeout = 15
Aug 09 19:39:10 user nova-compute[72441]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 19:39:10 user nova-compute[72441]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 19:39:10 user nova-compute[72441]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.FastAbort = Yes
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.InitialR2T = No
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.ImmediateData = Yes
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.MaxConnections = 1
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 19:39:10 user nova-compute[72441]: node.session.iscsi.ERL = 0
Aug 09 19:39:10 user nova-compute[72441]: node.session.scan = manual
Aug 09 19:39:10 user nova-compute[72441]: node.session.reopen_max = 0
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].address = 172.16.0.220
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].port = 3260
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].startup = manual
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].tcp.window_size = 524288
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].tcp.type_of_service = 0
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].timeo.logout_timeout = 15
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].timeo.login_timeout = 15
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].timeo.auth_timeout = 45
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].iscsi.DataDigest = None
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].iscsi.IFMarker = No
Aug 09 19:39:10 user nova-compute[72441]: node.conn[0].iscsi.OFMarker = No
Aug 09 19:39:10 user nova-compute[72441]: # END RECORD
Aug 09 19:39:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00476244-6873-49bb-8808-d6cd38b0eef5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647ae91-a11b-4bec-adad-306d8692d61d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlcIUzVg {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlcIUzVg" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74edaca-9f11-4fea-9bf0-700e260c8477]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jlcIUzVg'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b6f4d5-cd49-4a70-8707-7dae546e57fe]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[03db43e9-003b-414b-8200-18816dc99161]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:10 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:10 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:10 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:10 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] HCTL ('33', '0', '0', 0) found on session 49 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4032ca-d646-4964-91be-67d83a5eef19]: (4, ('0 0 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Searching for a device in session 49 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlcIUzVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23731633730323139', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633730323139', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264463955',display_name='tempest-ServerStableDeviceRescueTest-server-264463955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264463955',id=39,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHy1xInRStakLW2kSTF45qNLLvigbDkWhk0iPsV05izR1oVogWt91j/ZWosGznSob3kCMZUTIBWEasgiyWakDo38XUYqHDIBIK8Poqu8os185qpeMp83rUzZ6CUsUZ29A==',key_name='tempest-keypair-1862592562',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af13c3a40844c4d8d5118297e700385',ramdisk_id='',reservation_id='r-0hsa0nn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-449243577',owner_user_name='tempest-ServerStableDeviceRescueTest-449243577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7bd4f65ca8a4bd4aedd651a92fe5a19',uuid=1df1084d-ed05-4f3f-aad5-f8d57be3b0f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "vif_mac": "fa:16:3e:e3:6e:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converting VIF {"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "vif_mac": "fa:16:3e:e3:6e:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'pci_devices' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:39:10 user nova-compute[72441]:   <uuid>1df1084d-ed05-4f3f-aad5-f8d57be3b0f6</uuid>
Aug 09 19:39:10 user nova-compute[72441]:   <name>instance-00000027</name>
Aug 09 19:39:10 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:39:10 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:39:10 user nova-compute[72441]:   <metadata>
Aug 09 19:39:10 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:39:10 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:39:10 user nova-compute[72441]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-264463955</nova:name>
Aug 09 19:39:10 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:39:10</nova:creationTime>
Aug 09 19:39:10 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:39:10 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:39:10 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:39:10 user nova-compute[72441]:       <nova:owner>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:user uuid="d7bd4f65ca8a4bd4aedd651a92fe5a19">tempest-ServerStableDeviceRescueTest-449243577-project-member</nova:user>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:project uuid="4af13c3a40844c4d8d5118297e700385">tempest-ServerStableDeviceRescueTest-449243577</nova:project>
Aug 09 19:39:10 user nova-compute[72441]:       </nova:owner>
Aug 09 19:39:10 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:39:10 user nova-compute[72441]:       <nova:ports>
Aug 09 19:39:10 user nova-compute[72441]:         <nova:port uuid="77342bf2-a694-45b5-a931-061d51a3f226">
Aug 09 19:39:10 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:39:10 user nova-compute[72441]:         </nova:port>
Aug 09 19:39:10 user nova-compute[72441]:       </nova:ports>
Aug 09 19:39:10 user nova-compute[72441]:     </nova:instance>
Aug 09 19:39:10 user nova-compute[72441]:   </metadata>
Aug 09 19:39:10 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:39:10 user nova-compute[72441]:     <system>
Aug 09 19:39:10 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:39:10 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:39:10 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:39:10 user nova-compute[72441]:       <entry name="serial">1df1084d-ed05-4f3f-aad5-f8d57be3b0f6</entry>
Aug 09 19:39:10 user nova-compute[72441]:       <entry name="uuid">1df1084d-ed05-4f3f-aad5-f8d57be3b0f6</entry>
Aug 09 19:39:10 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:39:10 user nova-compute[72441]:     </system>
Aug 09 19:39:10 user nova-compute[72441]:   </sysinfo>
Aug 09 19:39:10 user nova-compute[72441]:   <os>
Aug 09 19:39:10 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:39:10 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:39:10 user nova-compute[72441]:   </os>
Aug 09 19:39:10 user nova-compute[72441]:   <features>
Aug 09 19:39:10 user nova-compute[72441]:     <acpi/>
Aug 09 19:39:10 user nova-compute[72441]:     <apic/>
Aug 09 19:39:10 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:39:10 user nova-compute[72441]:   </features>
Aug 09 19:39:10 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:39:10 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:39:10 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:39:10 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:39:10 user nova-compute[72441]:   </clock>
Aug 09 19:39:10 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:39:10 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:39:10 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:39:10 user nova-compute[72441]:   </cpu>
Aug 09 19:39:10 user nova-compute[72441]:   <devices>
Aug 09 19:39:10 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:39:10 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:39:10 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk"/>
Aug 09 19:39:10 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:39:10 user nova-compute[72441]:     </disk>
Aug 09 19:39:10 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:39:10 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:39:10 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:39:10 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:39:10 user nova-compute[72441]:       <serial>36f6cfba-a6d6-490c-913f-e93ead9ea030</serial>
Aug 09 19:39:10 user nova-compute[72441]:     </disk>
Aug 09 19:39:10 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:39:10 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:39:10 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue"/>
Aug 09 19:39:10 user nova-compute[72441]:       <target dev="vdc" bus="virtio"/>
Aug 09 19:39:10 user nova-compute[72441]:       <boot order="1"/>
Aug 09 19:39:10 user nova-compute[72441]:     </disk>
Aug 09 19:39:10 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:39:10 user nova-compute[72441]:       <mac address="fa:16:3e:e3:6e:3d"/>
Aug 09 19:39:10 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:39:10 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:39:10 user nova-compute[72441]:       <target dev="tap77342bf2-a6"/>
Aug 09 19:39:10 user nova-compute[72441]:     </interface>
Aug 09 19:39:10 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:39:10 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/console.log" append="off"/>
Aug 09 19:39:10 user nova-compute[72441]:     </serial>
Aug 09 19:39:10 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:39:10 user nova-compute[72441]:     <video>
Aug 09 19:39:10 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:39:10 user nova-compute[72441]:     </video>
Aug 09 19:39:10 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:39:10 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:39:10 user nova-compute[72441]:     </rng>
Aug 09 19:39:10 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:39:10 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:39:10 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:39:10 user nova-compute[72441]:     </memballoon>
Aug 09 19:39:10 user nova-compute[72441]:   </devices>
Aug 09 19:39:10 user nova-compute[72441]: </domain>
Aug 09 19:39:10 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:39:10 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance destroyed successfully.
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] No VIF found with MAC fa:16:3e:e3:6e:3d, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:39:10 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Took 0.53 seconds to deallocate network for instance.
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-190c908a-8407-416f-958e-c5ff5eedffdb req-e0e2bbdf-689c-4056-813a-e51b51b06555 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-deleted-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:39:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:11 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Deleted allocations for instance d643ae7c-ca03-4921-b6d2-66433a539cde
Aug 09 19:39:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b3ec9169-f914-435a-8020-2f76d7fbcca0 tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.903s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-e1dd2614-25fc-47be-8787-0e429fccdda1 req-b448e828-c4ff-4dcd-b8de-b05a67fac910 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e1dd2614-25fc-47be-8787-0e429fccdda1 req-b448e828-c4ff-4dcd-b8de-b05a67fac910 service nova] Acquiring lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e1dd2614-25fc-47be-8787-0e429fccdda1 req-b448e828-c4ff-4dcd-b8de-b05a67fac910 service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e1dd2614-25fc-47be-8787-0e429fccdda1 req-b448e828-c4ff-4dcd-b8de-b05a67fac910 service nova] Lock "d643ae7c-ca03-4921-b6d2-66433a539cde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-e1dd2614-25fc-47be-8787-0e429fccdda1 req-b448e828-c4ff-4dcd-b8de-b05a67fac910 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] No waiting events found dispatching network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:11 user nova-compute[72441]: WARNING nova.compute.manager [req-e1dd2614-25fc-47be-8787-0e429fccdda1 req-b448e828-c4ff-4dcd-b8de-b05a67fac910 service nova] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Received unexpected event network-vif-plugged-18515de4-95d3-463f-a469-61abac987981 for instance with vm_state deleted and task_state None.
Aug 09 19:39:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'info_cache' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:13 user nova-compute[72441]: WARNING nova.compute.manager [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state active and task_state rescuing.
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:13 user nova-compute[72441]: WARNING nova.compute.manager [req-852f8d5f-9dea-4e06-8408-92bd9385ca28 req-943b60ff-e697-4179-8586-4d51c6663701 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state active and task_state rescuing.
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:39:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance destroyed successfully.
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'resources' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc484855c-49, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:14 user nova-compute[72441]: INFO os_vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49')
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:39:14 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae590dff-0eae-4b95-9838-d58ebcab0f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609954.3773894, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:39:14 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Resumed (Lifecycle Event)
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6998d872-1ce9-48ea-b5e6-562a7dbc69d7 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaee4ff-3892-434c-b94e-f572d264516d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90592ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1f5eb-fd75-4bf2-a8a6-f17ed577a309]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609954.3779786, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:39:14 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Started (Lifecycle Event)
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e15a5e-523c-402c-8d14-9b4554b1f804]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c131b06f-6e82-4b70-b63d-8d22b6637518]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8969cc76-c2e3-453f-bccf-fc30269c315a]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcd0252-7712-4767-a5dd-352fec5d09ea]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff5d1f-c44a-4554-8e93-f10f18d3a79d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]
Aug 09 19:39:14 user nova-compute[72441]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.
Aug 09 19:39:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fa2db-f48b-4135-bb3d-d0750055578c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== disconnect_volume: return (306ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start _get_guest_xml network_info=[{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c004c872-c398-4e9c-867d-e9d1cddf4735', 'attached_at': '', 'detached_at': '', 'volume_id': 'aaa5cd57-c2b9-44af-b142-ffb570195aa6', 'serial': 'aaa5cd57-c2b9-44af-b142-ffb570195aa6'}, 'attachment_id': 'e5884234-567b-4d92-86fa-0b92faaee889', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'numa_topology' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:14 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:39:14 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'vcpu_model' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:39:14 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:14 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:14 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaabd76-eed5-4680-ac2e-0ec90f6772ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:39:14 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6895d-0a42-4898-bde7-7b0347bfedf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6] added
Aug 09 19:39:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6ccbb-e88e-47a1-87f6-a6a568011690]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adbe0ca-2da6-4ad4-8cc5-34b2bacc1be9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBVbMpkc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBVbMpkc" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eeb562-11f4-45d4-982c-bc97a5bce45d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RBVbMpkc'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c321fa7-9f7a-445f-9704-10cb4e1aa663]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896a8ff-3cfd-44a9-a0af-86d1c68a69bc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f27270-2e4e-4df3-ae92-5c658d9283d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]
Aug 09 19:39:15 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.
Aug 09 19:39:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f5fc19-4cb2-4e22-a1ae-6e21b14db4bd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e3121-a5b4-454c-93fb-a17860ec4761]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:15 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:15 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:15 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:15 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe080c-ad60-4016-a6bf-a99bbd8bb87d]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:15 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26461346433663933', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461346433663933', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'pci_devices' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:39:16 user nova-compute[72441]:   <uuid>c004c872-c398-4e9c-867d-e9d1cddf4735</uuid>
Aug 09 19:39:16 user nova-compute[72441]:   <name>instance-00000028</name>
Aug 09 19:39:16 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:39:16 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:39:16 user nova-compute[72441]:   <metadata>
Aug 09 19:39:16 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:39:16 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:39:16 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1348893918</nova:name>
Aug 09 19:39:16 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:39:14</nova:creationTime>
Aug 09 19:39:16 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:39:16 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:39:16 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:39:16 user nova-compute[72441]:       <nova:owner>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:user uuid="febf31bc22ae4e00a5e7be7c44708626">tempest-AttachVolumeTestJSON-333200942-project-member</nova:user>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:project uuid="bb19329778d94a21828a4d3d61d75217">tempest-AttachVolumeTestJSON-333200942</nova:project>
Aug 09 19:39:16 user nova-compute[72441]:       </nova:owner>
Aug 09 19:39:16 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:39:16 user nova-compute[72441]:       <nova:ports>
Aug 09 19:39:16 user nova-compute[72441]:         <nova:port uuid="c484855c-49b5-4ca8-8e4a-4933ab67a57a">
Aug 09 19:39:16 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:39:16 user nova-compute[72441]:         </nova:port>
Aug 09 19:39:16 user nova-compute[72441]:       </nova:ports>
Aug 09 19:39:16 user nova-compute[72441]:     </nova:instance>
Aug 09 19:39:16 user nova-compute[72441]:   </metadata>
Aug 09 19:39:16 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:39:16 user nova-compute[72441]:     <system>
Aug 09 19:39:16 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:39:16 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:39:16 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:39:16 user nova-compute[72441]:       <entry name="serial">c004c872-c398-4e9c-867d-e9d1cddf4735</entry>
Aug 09 19:39:16 user nova-compute[72441]:       <entry name="uuid">c004c872-c398-4e9c-867d-e9d1cddf4735</entry>
Aug 09 19:39:16 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:39:16 user nova-compute[72441]:     </system>
Aug 09 19:39:16 user nova-compute[72441]:   </sysinfo>
Aug 09 19:39:16 user nova-compute[72441]:   <os>
Aug 09 19:39:16 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:39:16 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:39:16 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:39:16 user nova-compute[72441]:   </os>
Aug 09 19:39:16 user nova-compute[72441]:   <features>
Aug 09 19:39:16 user nova-compute[72441]:     <acpi/>
Aug 09 19:39:16 user nova-compute[72441]:     <apic/>
Aug 09 19:39:16 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:39:16 user nova-compute[72441]:   </features>
Aug 09 19:39:16 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:39:16 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:39:16 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:39:16 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:39:16 user nova-compute[72441]:   </clock>
Aug 09 19:39:16 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:39:16 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:39:16 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:39:16 user nova-compute[72441]:   </cpu>
Aug 09 19:39:16 user nova-compute[72441]:   <devices>
Aug 09 19:39:16 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:39:16 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:39:16 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk"/>
Aug 09 19:39:16 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:39:16 user nova-compute[72441]:     </disk>
Aug 09 19:39:16 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:39:16 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:39:16 user nova-compute[72441]:       <source dev="/dev/sdc"/>
Aug 09 19:39:16 user nova-compute[72441]:       <target dev="vdb" bus="virtio"/>
Aug 09 19:39:16 user nova-compute[72441]:       <serial>aaa5cd57-c2b9-44af-b142-ffb570195aa6</serial>
Aug 09 19:39:16 user nova-compute[72441]:     </disk>
Aug 09 19:39:16 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:39:16 user nova-compute[72441]:       <mac address="fa:16:3e:9f:69:22"/>
Aug 09 19:39:16 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:39:16 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:39:16 user nova-compute[72441]:       <target dev="tapc484855c-49"/>
Aug 09 19:39:16 user nova-compute[72441]:     </interface>
Aug 09 19:39:16 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:39:16 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/console.log" append="off"/>
Aug 09 19:39:16 user nova-compute[72441]:     </serial>
Aug 09 19:39:16 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:39:16 user nova-compute[72441]:     <video>
Aug 09 19:39:16 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:39:16 user nova-compute[72441]:     </video>
Aug 09 19:39:16 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:39:16 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:39:16 user nova-compute[72441]:     </rng>
Aug 09 19:39:16 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:39:16 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:39:16 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:39:16 user nova-compute[72441]:     </memballoon>
Aug 09 19:39:16 user nova-compute[72441]:   </devices>
Aug 09 19:39:16 user nova-compute[72441]: </domain>
Aug 09 19:39:16 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'trusted_certs' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Cannot resize image /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'migration_context' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG os_vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc484855c-49, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc484855c-49, col_values=(('external_ids', {'iface-id': 'c484855c-49b5-4ca8-8e4a-4933ab67a57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:69:22', 'vm-uuid': 'c004c872-c398-4e9c-867d-e9d1cddf4735'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:39:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:16 user nova-compute[72441]: INFO os_vif [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49')
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-71cb6e0d-e250-4490-b251-9435b001fe0c req-7c8ba19d-5b8b-4af3-88ab-3852601080b7 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-71cb6e0d-e250-4490-b251-9435b001fe0c req-7c8ba19d-5b8b-4af3-88ab-3852601080b7 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-71cb6e0d-e250-4490-b251-9435b001fe0c req-7c8ba19d-5b8b-4af3-88ab-3852601080b7 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-71cb6e0d-e250-4490-b251-9435b001fe0c req-7c8ba19d-5b8b-4af3-88ab-3852601080b7 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-71cb6e0d-e250-4490-b251-9435b001fe0c req-7c8ba19d-5b8b-4af3-88ab-3852601080b7 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:18 user nova-compute[72441]: WARNING nova.compute.manager [req-71cb6e0d-e250-4490-b251-9435b001fe0c req-7c8ba19d-5b8b-4af3-88ab-3852601080b7 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state stopped and task_state powering-on.
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609960.5785825, c004c872-c398-4e9c-867d-e9d1cddf4735 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:39:20 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Resumed (Lifecycle Event)
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-2a97d616-bd8e-4915-890e-1575394b2ead req-55f765c9-276a-4454-8f7a-583bbba7a2a8 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2a97d616-bd8e-4915-890e-1575394b2ead req-55f765c9-276a-4454-8f7a-583bbba7a2a8 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2a97d616-bd8e-4915-890e-1575394b2ead req-55f765c9-276a-4454-8f7a-583bbba7a2a8 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2a97d616-bd8e-4915-890e-1575394b2ead req-55f765c9-276a-4454-8f7a-583bbba7a2a8 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-2a97d616-bd8e-4915-890e-1575394b2ead req-55f765c9-276a-4454-8f7a-583bbba7a2a8 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:20 user nova-compute[72441]: WARNING nova.compute.manager [req-2a97d616-bd8e-4915-890e-1575394b2ead req-55f765c9-276a-4454-8f7a-583bbba7a2a8 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state stopped and task_state powering-on.
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:39:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance rebooted successfully.
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b28adf95-c49d-48c6-86d5-1d733eb277f3 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:39:20 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691609960.5838156, c004c872-c398-4e9c-867d-e9d1cddf4735 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:39:20 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Started (Lifecycle Event)
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:39:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:25 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609950.0178757, d643ae7c-ca03-4921-b6d2-66433a539cde => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:39:25 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] VM Stopped (Lifecycle Event)
Aug 09 19:39:25 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2dad8e9f-0562-4158-84ee-ade6e8efc562 None None] [instance: d643ae7c-ca03-4921-b6d2-66433a539cde] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "98d0d122-7e57-4f77-9581-3447e9672e36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:25 user nova-compute[72441]: INFO nova.compute.manager [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Terminating instance
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-82fd490f-8ce5-4a53-bd87-a0895b89d0e8 req-c56712a9-a8a5-4414-9979-e3e575b58819 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-vif-unplugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-82fd490f-8ce5-4a53-bd87-a0895b89d0e8 req-c56712a9-a8a5-4414-9979-e3e575b58819 service nova] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-82fd490f-8ce5-4a53-bd87-a0895b89d0e8 req-c56712a9-a8a5-4414-9979-e3e575b58819 service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-82fd490f-8ce5-4a53-bd87-a0895b89d0e8 req-c56712a9-a8a5-4414-9979-e3e575b58819 service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-82fd490f-8ce5-4a53-bd87-a0895b89d0e8 req-c56712a9-a8a5-4414-9979-e3e575b58819 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] No waiting events found dispatching network-vif-unplugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-82fd490f-8ce5-4a53-bd87-a0895b89d0e8 req-c56712a9-a8a5-4414-9979-e3e575b58819 service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-vif-unplugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:39:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Instance destroyed successfully.
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'resources' on Instance uuid 98d0d122-7e57-4f77-9581-3447e9672e36 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-89748341',display_name='tempest-TestVolumeBootPattern-volume-backed-server-89748341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-89748341',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZs+YWiWzAL3kBR8JlVwPkYzWkZaRh50zJW40CFOqclROO4LunUXeCOaloEFMiyA1iGLk6cZXw2C5Vw53ZsdjbHBflO6ouQXbT6G+Xii9wshvvFYi3IuVt9tb7Htt6udw==',key_name='tempest-keypair-1280248523',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:34:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-ladzrsyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=98d0d122-7e57-4f77-9581-3447e9672e36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "address": "fa:16:3e:14:f7:dd", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa49642b5-a6", "ovs_interfaceid": "a49642b5-a644-4f8b-bda5-d8aabcb3946c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_vif [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa49642b5-a6, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:39:26 user nova-compute[72441]: INFO os_vif [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:f7:dd,bridge_name='br-int',has_traffic_filtering=True,id=a49642b5-a644-4f8b-bda5-d8aabcb3946c,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa49642b5-a6')
Aug 09 19:39:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpHRBXil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:39:26 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c9f6b-cb20-48b6-a492-cbf7534bbfd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaffd1e-31b5-4148-aee1-b729fced82d7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:26 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:26 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 (non-flash)
Aug 09 19:39:26 user nova-compute[72441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:39:26 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:39:26 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e0bca9-e3b8-4340-953a-b4a1ca4ca9af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fe170-78a6-4940-a87c-955922b876df]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[50086807-d12c-4c52-bcc1-6c6caadc8f4d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:39:26 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b4c9f-062c-482f-856c-53811847996f]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55eb11d-7f30-4b54-8995-d61660e36cb5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc163966-1e71-4541-829f-e187d690a9d6]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260]
Aug 09 19:39:27 user nova-compute[72441]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280, portal: 172.16.0.220,3260] successful.
Aug 09 19:39:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21c659ea-fe35-4e43-a5fa-9080d1e1f280 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[481fee2e-1a7b-44fe-94a4-a2d089aa5555]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== disconnect_volume: return (325ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:39:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Deleting instance files /opt/stack/data/nova/instances/98d0d122-7e57-4f77-9581-3447e9672e36_del
Aug 09 19:39:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Deletion of /opt/stack/data/nova/instances/98d0d122-7e57-4f77-9581-3447e9672e36_del complete
Aug 09 19:39:27 user nova-compute[72441]: INFO nova.compute.manager [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 19:39:27 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:39:27 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:39:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-42d0ba02-98b3-47a0-9ff8-dbe9dc6062a8 req-96223437-d5a8-481d-b131-a1bf66315cdc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-42d0ba02-98b3-47a0-9ff8-dbe9dc6062a8 req-96223437-d5a8-481d-b131-a1bf66315cdc service nova] Acquiring lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-42d0ba02-98b3-47a0-9ff8-dbe9dc6062a8 req-96223437-d5a8-481d-b131-a1bf66315cdc service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-42d0ba02-98b3-47a0-9ff8-dbe9dc6062a8 req-96223437-d5a8-481d-b131-a1bf66315cdc service nova] Lock "98d0d122-7e57-4f77-9581-3447e9672e36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-42d0ba02-98b3-47a0-9ff8-dbe9dc6062a8 req-96223437-d5a8-481d-b131-a1bf66315cdc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] No waiting events found dispatching network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:39:28 user nova-compute[72441]: WARNING nova.compute.manager [req-42d0ba02-98b3-47a0-9ff8-dbe9dc6062a8 req-96223437-d5a8-481d-b131-a1bf66315cdc service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received unexpected event network-vif-plugged-a49642b5-a644-4f8b-bda5-d8aabcb3946c for instance with vm_state active and task_state deleting.
Aug 09 19:39:28 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:39:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-ec4596f4-ee4e-43b2-ba6e-860aef4e6bb2 req-8aed0284-387a-44b4-84de-75a4da951f2f service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Received event network-vif-deleted-a49642b5-a644-4f8b-bda5-d8aabcb3946c {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:39:28 user nova-compute[72441]: INFO nova.compute.manager [req-ec4596f4-ee4e-43b2-ba6e-860aef4e6bb2 req-8aed0284-387a-44b4-84de-75a4da951f2f service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Neutron deleted interface a49642b5-a644-4f8b-bda5-d8aabcb3946c; detaching it from the instance and deleting it from the info cache
Aug 09 19:39:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-ec4596f4-ee4e-43b2-ba6e-860aef4e6bb2 req-8aed0284-387a-44b4-84de-75a4da951f2f service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:39:28 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Took 1.43 seconds to deallocate network for instance.
Aug 09 19:39:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-ec4596f4-ee4e-43b2-ba6e-860aef4e6bb2 req-8aed0284-387a-44b4-84de-75a4da951f2f service nova] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Detach interface failed, port_id=a49642b5-a644-4f8b-bda5-d8aabcb3946c, reason: Instance 98d0d122-7e57-4f77-9581-3447e9672e36 could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:39:29 user nova-compute[72441]: INFO nova.compute.manager [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Took 0.81 seconds to detach 1 volumes for instance.
Aug 09 19:39:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Deleting volume: 21c659ea-fe35-4e43-a5fa-9080d1e1f280 {{(pid=72441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 19:39:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:29 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:39:29 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:39:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:29 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Deleted allocations for instance 98d0d122-7e57-4f77-9581-3447e9672e36
Aug 09 19:39:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-45ecbc93-0e0e-4b80-b1a9-573ddac5ef2a tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "98d0d122-7e57-4f77-9581-3447e9672e36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.936s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:39:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:39:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:39:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:39:40 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691609966.7507682, 98d0d122-7e57-4f77-9581-3447e9672e36 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:39:41 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] VM Stopped (Lifecycle Event)
Aug 09 19:39:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6a0eee28-fdcf-4d4b-90f9-c4d3420f354d None None] [instance: 98d0d122-7e57-4f77-9581-3447e9672e36] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:39:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:39:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:39:43 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:39:43 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8270MB free_disk=25.08957290649414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance e30cf305-f264-4aab-a4cf-f555a57e8db3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:39:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:39:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:39:59 user nova-compute[72441]: INFO nova.compute.manager [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Terminating instance
Aug 09 19:39:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:39:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fa59b1f6-6d41-4c6b-b4b5-4722049e499b req-8335f5fa-0e51-410a-976d-5ef0bb8d1387 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fa59b1f6-6d41-4c6b-b4b5-4722049e499b req-8335f5fa-0e51-410a-976d-5ef0bb8d1387 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fa59b1f6-6d41-4c6b-b4b5-4722049e499b req-8335f5fa-0e51-410a-976d-5ef0bb8d1387 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-fa59b1f6-6d41-4c6b-b4b5-4722049e499b req-8335f5fa-0e51-410a-976d-5ef0bb8d1387 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fa59b1f6-6d41-4c6b-b4b5-4722049e499b req-8335f5fa-0e51-410a-976d-5ef0bb8d1387 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-fa59b1f6-6d41-4c6b-b4b5-4722049e499b req-8335f5fa-0e51-410a-976d-5ef0bb8d1387 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Instance destroyed successfully.
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lazy-loading 'resources' on Instance uuid e30cf305-f264-4aab-a4cf-f555a57e8db3 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-528314346',display_name='tempest-ServerRescueNegativeTestJSON-server-528314346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-528314346',id=20,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:27:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcefc0bffad468b82ae957092668524',ramdisk_id='',reservation_id='r-p9iy01kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340711293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340711293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:29:31Z,user_data=None,user_id='3bdbd35f8a0d4f3297acb453e3109176',uuid=e30cf305-f264-4aab-a4cf-f555a57e8db3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converting VIF {"id": "9c11f350-193b-4573-828c-1c72e7effd21", "address": "fa:16:3e:e7:08:91", "network": {"id": "3e65baed-3844-49f5-ba4b-863e78425a5d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1439365618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcefc0bffad468b82ae957092668524", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c11f350-19", "ovs_interfaceid": "9c11f350-193b-4573-828c-1c72e7effd21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG os_vif [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c11f350-19, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:40:00 user nova-compute[72441]: INFO os_vif [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:08:91,bridge_name='br-int',has_traffic_filtering=True,id=9c11f350-193b-4573-828c-1c72e7effd21,network=Network(3e65baed-3844-49f5-ba4b-863e78425a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c11f350-19')
Aug 09 19:40:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Deleting instance files /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3_del
Aug 09 19:40:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Deletion of /opt/stack/data/nova/instances/e30cf305-f264-4aab-a4cf-f555a57e8db3_del complete
Aug 09 19:40:00 user nova-compute[72441]: INFO nova.compute.manager [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 09 19:40:00 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:40:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:01 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Took 0.75 seconds to deallocate network for instance.
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-68c47f9f-37fd-45fb-ad75-67eca092a178 req-a0f8347c-b58d-4ef8-a0a7-f7deba060a63 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-deleted-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:40:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:01 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Deleted allocations for instance e30cf305-f264-4aab-a4cf-f555a57e8db3
Aug 09 19:40:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cfe66354-685d-42ef-a6a7-feb6a636bf6b tempest-ServerRescueNegativeTestJSON-1340711293 tempest-ServerRescueNegativeTestJSON-1340711293-project-member] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.025s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:02 user nova-compute[72441]: WARNING nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state deleted and task_state None.
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:02 user nova-compute[72441]: WARNING nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state deleted and task_state None.
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:02 user nova-compute[72441]: WARNING nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state deleted and task_state None.
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:02 user nova-compute[72441]: WARNING nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-unplugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state deleted and task_state None.
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Acquiring lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] Lock "e30cf305-f264-4aab-a4cf-f555a57e8db3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:02 user nova-compute[72441]: DEBUG nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] No waiting events found dispatching network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:02 user nova-compute[72441]: WARNING nova.compute.manager [req-60ceb0a6-e89f-4b2c-9c2e-c7f7a64fd082 req-158382b2-b2dd-4f03-94cb-f3f458e48704 service nova] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Received unexpected event network-vif-plugged-9c11f350-193b-4573-828c-1c72e7effd21 for instance with vm_state deleted and task_state None.
Aug 09 19:40:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:15 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610000.4378717, e30cf305-f264-4aab-a4cf-f555a57e8db3 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:40:15 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] VM Stopped (Lifecycle Event)
Aug 09 19:40:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8198eaf2-512b-46bc-a053-ebaedbc528f0 None None] [instance: e30cf305-f264-4aab-a4cf-f555a57e8db3] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:40:29 user nova-compute[72441]: INFO nova.compute.claims [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Claim successful on node user
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.network.neutron [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:40:29 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:40:29 user nova-compute[72441]: INFO nova.virt.block_device [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Booting with volume 1c1d2544-9373-4871-808f-0cb5c141d972 at /dev/vda
Aug 09 19:40:29 user nova-compute[72441]: DEBUG nova.policy [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd066b4d22049d0b2129ad1f38ef9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ae81254564eadaf8042330cb1fdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c604c-0ac7-4ed6-b42e-a80a7f215840]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7864bd7-ca3d-443d-9e79-4e7ee3c5ec30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[035b183a-7b4e-4ef1-84e8-a2b63a51c5af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a5ab2-62a5-4626-aee4-d5aa8dc75a46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:40:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:40:30 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbee5a-7d2d-4356-af45-fbf28a889b87]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG os_brick.utils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updating existing volume attachment record: 907071df-335f-4d5d-8196-1c50c21f3037 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:40:30 user nova-compute[72441]: INFO nova.compute.claims [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Claim successful on node user
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Successfully created port: 3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:40:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:40:30 user nova-compute[72441]: INFO nova.virt.block_device [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Booting with volume 547c3d8c-2856-4034-9fd0-766d6d9db408 at /dev/vda
Aug 09 19:40:30 user nova-compute[72441]: DEBUG nova.policy [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb23b737f92a4b638b43ea8a1d195a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff19d044abd840ab98dac7fe1e20ddc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG os_brick.utils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ac535f-f3d4-427d-8d7d-c443c0245916]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410b984-e4be-40ea-bb16-76410ccfe01a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6a139a-8936-4267-92c1-a45545fa64c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[075728f4-c4f1-4c4e-b711-5ba86baa59e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:40:31 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f6b6d2-e618-4f03-b25b-58cd2d1d7a4f]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG os_brick.utils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating existing volume attachment record: a7848af3-6d1a-4071-94f2-b95be1faab89 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Successfully updated port: 3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquired lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Successfully created port: 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-changed-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Refreshing instance network info cache due to event network-changed-3d5b27e5-9667-4491-bae9-436a54847c46. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] Acquiring lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:31 user nova-compute[72441]: DEBUG nova.network.neutron [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updating instance_info_cache with network_info: [{"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Releasing lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Instance network_info: |[{"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] Acquired lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Refreshing network info cache for port 3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Successfully updated port: 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.compute.manager [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing instance network info cache due to event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updated VIF entry in instance network info cache for port 3d5b27e5-9667-4491-bae9-436a54847c46. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updating instance_info_cache with network_info: [{"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-86ba84ca-e209-42f4-92a6-8a87482db14b req-a7e815e9-28d3-4159-b9ab-33b0b2188dd9 service nova] Releasing lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance network_info: |[{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:32 user nova-compute[72441]: DEBUG nova.network.neutron [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:40:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updated VIF entry in instance network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:40:33 user nova-compute[72441]: DEBUG nova.network.neutron [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6b116e8a-9701-4055-b782-ea3959e7faeb req-8622f673-9f3a-44cd-9a19-774bdf0075e2 service nova] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:40:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:36 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:38 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:40:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:40:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:40:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:40:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:40:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:40:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Creating image(s)
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Ensure instance console log exists: /opt/stack/data/nova/instances/4a0e3f0f-525d-4414-9430-e7dd01cf2c67/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Start _get_guest_xml network_info=[{"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a0e3f0f-525d-4414-9430-e7dd01cf2c67', 'attached_at': '', 'detached_at': '', 'volume_id': '1c1d2544-9373-4871-808f-0cb5c141d972', 'serial': '1c1d2544-9373-4871-808f-0cb5c141d972'}, 'attachment_id': '907071df-335f-4d5d-8196-1c50c21f3037', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:40:41 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:40:41 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:40:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:40:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:40:41 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f530cc-0c61-4f31-b816-e81880c444d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:40:41 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a19de2d-d7b8-42bd-b9d4-ec1998dd2051]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972] added
Aug 09 19:40:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d39478-58b2-49b6-9c65-781ef14faa7f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a2340f-e87d-40f2-898e-007c919c7e09]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqJCUlkS {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqJCUlkS" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f142e6c9-edf0-4327-bb14-575aa655935d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqJCUlkS'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[805b71ee-dc9e-4800-9e2e-266128c318cb]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e28690-b843-44f2-8a0f-077f68a2fff1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec9507-c952-41da-baf9-b33c82f16dd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]
Aug 09 19:40:41 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.
Aug 09 19:40:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a0ca64-6db3-45b5-be3b-6ff765959119]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3d41a2-0ceb-4ba2-8060-fd3ad3d53ee8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:40:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d8f11-46a6-4941-aee6-919cf7265b20]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:40:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23231346133373634', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231346133373634', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-696001244',display_name='tempest-TestVolumeBootPattern-server-696001244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-696001244',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-bqaq6ayi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:40:30Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=4a0e3f0f-525d-4414-9430-e7dd01cf2c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:40:42 user nova-compute[72441]:   <uuid>4a0e3f0f-525d-4414-9430-e7dd01cf2c67</uuid>
Aug 09 19:40:42 user nova-compute[72441]:   <name>instance-0000002a</name>
Aug 09 19:40:42 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:40:42 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:40:42 user nova-compute[72441]:   <metadata>
Aug 09 19:40:42 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:40:42 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:40:42 user nova-compute[72441]:       <nova:name>tempest-TestVolumeBootPattern-server-696001244</nova:name>
Aug 09 19:40:42 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:40:41</nova:creationTime>
Aug 09 19:40:42 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:40:42 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:40:42 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:40:42 user nova-compute[72441]:       <nova:owner>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:user uuid="0fd066b4d22049d0b2129ad1f38ef9e4">tempest-TestVolumeBootPattern-1486219267-project-member</nova:user>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:project uuid="256ae81254564eadaf8042330cb1fdce">tempest-TestVolumeBootPattern-1486219267</nova:project>
Aug 09 19:40:42 user nova-compute[72441]:       </nova:owner>
Aug 09 19:40:42 user nova-compute[72441]:       <nova:ports>
Aug 09 19:40:42 user nova-compute[72441]:         <nova:port uuid="3d5b27e5-9667-4491-bae9-436a54847c46">
Aug 09 19:40:42 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 19:40:42 user nova-compute[72441]:         </nova:port>
Aug 09 19:40:42 user nova-compute[72441]:       </nova:ports>
Aug 09 19:40:42 user nova-compute[72441]:     </nova:instance>
Aug 09 19:40:42 user nova-compute[72441]:   </metadata>
Aug 09 19:40:42 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:40:42 user nova-compute[72441]:     <system>
Aug 09 19:40:42 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:40:42 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:40:42 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:40:42 user nova-compute[72441]:       <entry name="serial">4a0e3f0f-525d-4414-9430-e7dd01cf2c67</entry>
Aug 09 19:40:42 user nova-compute[72441]:       <entry name="uuid">4a0e3f0f-525d-4414-9430-e7dd01cf2c67</entry>
Aug 09 19:40:42 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:40:42 user nova-compute[72441]:     </system>
Aug 09 19:40:42 user nova-compute[72441]:   </sysinfo>
Aug 09 19:40:42 user nova-compute[72441]:   <os>
Aug 09 19:40:42 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:40:42 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:40:42 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:40:42 user nova-compute[72441]:   </os>
Aug 09 19:40:42 user nova-compute[72441]:   <features>
Aug 09 19:40:42 user nova-compute[72441]:     <acpi/>
Aug 09 19:40:42 user nova-compute[72441]:     <apic/>
Aug 09 19:40:42 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:40:42 user nova-compute[72441]:   </features>
Aug 09 19:40:42 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:40:42 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:40:42 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:40:42 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:40:42 user nova-compute[72441]:   </clock>
Aug 09 19:40:42 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:40:42 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:40:42 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:40:42 user nova-compute[72441]:   </cpu>
Aug 09 19:40:42 user nova-compute[72441]:   <devices>
Aug 09 19:40:42 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:40:42 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:40:42 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:40:42 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:40:42 user nova-compute[72441]:       <serial>1c1d2544-9373-4871-808f-0cb5c141d972</serial>
Aug 09 19:40:42 user nova-compute[72441]:     </disk>
Aug 09 19:40:42 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:40:42 user nova-compute[72441]:       <mac address="fa:16:3e:c1:a5:2d"/>
Aug 09 19:40:42 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:40:42 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:40:42 user nova-compute[72441]:       <target dev="tap3d5b27e5-96"/>
Aug 09 19:40:42 user nova-compute[72441]:     </interface>
Aug 09 19:40:42 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:40:42 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/4a0e3f0f-525d-4414-9430-e7dd01cf2c67/console.log" append="off"/>
Aug 09 19:40:42 user nova-compute[72441]:     </serial>
Aug 09 19:40:42 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:40:42 user nova-compute[72441]:     <video>
Aug 09 19:40:42 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:40:42 user nova-compute[72441]:     </video>
Aug 09 19:40:42 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:40:42 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:40:42 user nova-compute[72441]:     </rng>
Aug 09 19:40:42 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:40:42 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:40:42 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:40:42 user nova-compute[72441]:     </memballoon>
Aug 09 19:40:42 user nova-compute[72441]:   </devices>
Aug 09 19:40:42 user nova-compute[72441]: </domain>
Aug 09 19:40:42 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-696001244',display_name='tempest-TestVolumeBootPattern-server-696001244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-696001244',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-bqaq6ayi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:40:30Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=4a0e3f0f-525d-4414-9430-e7dd01cf2c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG os_vif [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d5b27e5-96, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d5b27e5-96, col_values=(('external_ids', {'iface-id': '3d5b27e5-9667-4491-bae9-436a54847c46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:a5:2d', 'vm-uuid': '4a0e3f0f-525d-4414-9430-e7dd01cf2c67'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:42 user nova-compute[72441]: INFO os_vif [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96')
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:40:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No VIF found with MAC fa:16:3e:c1:a5:2d, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-bc64ce05-69b9-4c92-beb8-8a74d630d855 req-93f7c937-1b9a-417b-b7f0-2777e27fef0e service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bc64ce05-69b9-4c92-beb8-8a74d630d855 req-93f7c937-1b9a-417b-b7f0-2777e27fef0e service nova] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bc64ce05-69b9-4c92-beb8-8a74d630d855 req-93f7c937-1b9a-417b-b7f0-2777e27fef0e service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-bc64ce05-69b9-4c92-beb8-8a74d630d855 req-93f7c937-1b9a-417b-b7f0-2777e27fef0e service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-bc64ce05-69b9-4c92-beb8-8a74d630d855 req-93f7c937-1b9a-417b-b7f0-2777e27fef0e service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] No waiting events found dispatching network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:44 user nova-compute[72441]: WARNING nova.compute.manager [req-bc64ce05-69b9-4c92-beb8-8a74d630d855 req-93f7c937-1b9a-417b-b7f0-2777e27fef0e service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received unexpected event network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 for instance with vm_state building and task_state spawning.
Aug 09 19:40:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:40:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:45 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:40:45 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=25.113666534423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 5b0b69c2-28a7-444f-84ab-f47d63235dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610046.3010883, 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] VM Resumed (Lifecycle Event)
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Instance spawned successfully.
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610046.3057868, 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] VM Started (Lifecycle Event)
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:46 user nova-compute[72441]: INFO nova.compute.manager [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Took 17.12 seconds to build instance.
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d09aafa3-f176-4f0d-a91e-7484ac4fe5ab tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.214s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-1a018d22-2ab6-44a9-9562-a5245b9c0a9c req-8759fe42-edc7-4231-be36-063731d3fb6e service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1a018d22-2ab6-44a9-9562-a5245b9c0a9c req-8759fe42-edc7-4231-be36-063731d3fb6e service nova] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1a018d22-2ab6-44a9-9562-a5245b9c0a9c req-8759fe42-edc7-4231-be36-063731d3fb6e service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1a018d22-2ab6-44a9-9562-a5245b9c0a9c req-8759fe42-edc7-4231-be36-063731d3fb6e service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-1a018d22-2ab6-44a9-9562-a5245b9c0a9c req-8759fe42-edc7-4231-be36-063731d3fb6e service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] No waiting events found dispatching network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:46 user nova-compute[72441]: WARNING nova.compute.manager [req-1a018d22-2ab6-44a9-9562-a5245b9c0a9c req-8759fe42-edc7-4231-be36-063731d3fb6e service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received unexpected event network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 for instance with vm_state active and task_state None.
Aug 09 19:40:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:40:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Creating image(s)
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Ensure instance console log exists: /opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Start _get_guest_xml network_info=[{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b0b69c2-28a7-444f-84ab-f47d63235dbc', 'attached_at': '', 'detached_at': '', 'volume_id': '547c3d8c-2856-4034-9fd0-766d6d9db408', 'serial': '547c3d8c-2856-4034-9fd0-766d6d9db408'}, 'attachment_id': 'a7848af3-6d1a-4071-94f2-b95be1faab89', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:40:47 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:40:47 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:40:47 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:40:47 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:40:47 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f0a05a-035b-415f-a609-31d0e00710cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:40:47 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[515bde85-39df-4cab-9f18-51009ae43363]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408] added
Aug 09 19:40:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[46abe387-2561-46d8-84e1-78b8e52e6ed6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[38616dd3-b936-40c8-aec4-36e187fd88bd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHiwSXLl {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHiwSXLl" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad454f-2114-4c3c-8de5-21455438cdea]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHiwSXLl'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a2c006-cf7a-4125-9348-573b8a3cdc85]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[71827d8b-b140-4b20-8030-fad9e39fab6e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a09e80-e609-473b-aed5-0799bd25e2ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]
Aug 09 19:40:47 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.
Aug 09 19:40:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98329da6-290a-4925-86b3-c7c2f2cfd8c6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea1fd53-4700-4506-81e4-c148df3e67f4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:40:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.038s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5486a9ba-4eec-456f-a1a3-07e326cea87e]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:40:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26464636665393336', 'path': '/dev/sde'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464636665393336', 'path': '/dev/sde'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-414112240',display_name='tempest-TestShelveInstance-server-414112240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-414112240',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZFx7vZ5g5Xen3WE00to5BL9o7dbKBges/p9HSNvs37OMnEXgnyF9biWsRr8qexSO+Gup2ZURrb1zRWsHzw+i+hcXKTtkbYh1emOpx8kjwLEw8uoZDUv9Z4cSzoCBfAlA==',key_name='tempest-TestShelveInstance-595052958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff19d044abd840ab98dac7fe1e20ddc3',ramdisk_id='',reservation_id='r-ynxt8uc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1365792064',owner_user_name='tempest-TestShelveInstance-1365792064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:40:31Z,user_data=None,user_id='cb23b737f92a4b638b43ea8a1d195a5e',uuid=5b0b69c2-28a7-444f-84ab-f47d63235dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converting VIF {"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:40:48 user nova-compute[72441]:   <uuid>5b0b69c2-28a7-444f-84ab-f47d63235dbc</uuid>
Aug 09 19:40:48 user nova-compute[72441]:   <name>instance-0000002b</name>
Aug 09 19:40:48 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:40:48 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:40:48 user nova-compute[72441]:   <metadata>
Aug 09 19:40:48 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:40:48 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:40:48 user nova-compute[72441]:       <nova:name>tempest-TestShelveInstance-server-414112240</nova:name>
Aug 09 19:40:48 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:40:47</nova:creationTime>
Aug 09 19:40:48 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:40:48 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:40:48 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:40:48 user nova-compute[72441]:       <nova:owner>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:user uuid="cb23b737f92a4b638b43ea8a1d195a5e">tempest-TestShelveInstance-1365792064-project-member</nova:user>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:project uuid="ff19d044abd840ab98dac7fe1e20ddc3">tempest-TestShelveInstance-1365792064</nova:project>
Aug 09 19:40:48 user nova-compute[72441]:       </nova:owner>
Aug 09 19:40:48 user nova-compute[72441]:       <nova:ports>
Aug 09 19:40:48 user nova-compute[72441]:         <nova:port uuid="7f1f2da4-8966-4874-8261-8324c96e8257">
Aug 09 19:40:48 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 19:40:48 user nova-compute[72441]:         </nova:port>
Aug 09 19:40:48 user nova-compute[72441]:       </nova:ports>
Aug 09 19:40:48 user nova-compute[72441]:     </nova:instance>
Aug 09 19:40:48 user nova-compute[72441]:   </metadata>
Aug 09 19:40:48 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:40:48 user nova-compute[72441]:     <system>
Aug 09 19:40:48 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:40:48 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:40:48 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:40:48 user nova-compute[72441]:       <entry name="serial">5b0b69c2-28a7-444f-84ab-f47d63235dbc</entry>
Aug 09 19:40:48 user nova-compute[72441]:       <entry name="uuid">5b0b69c2-28a7-444f-84ab-f47d63235dbc</entry>
Aug 09 19:40:48 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:40:48 user nova-compute[72441]:     </system>
Aug 09 19:40:48 user nova-compute[72441]:   </sysinfo>
Aug 09 19:40:48 user nova-compute[72441]:   <os>
Aug 09 19:40:48 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:40:48 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:40:48 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:40:48 user nova-compute[72441]:   </os>
Aug 09 19:40:48 user nova-compute[72441]:   <features>
Aug 09 19:40:48 user nova-compute[72441]:     <acpi/>
Aug 09 19:40:48 user nova-compute[72441]:     <apic/>
Aug 09 19:40:48 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:40:48 user nova-compute[72441]:   </features>
Aug 09 19:40:48 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:40:48 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:40:48 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:40:48 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:40:48 user nova-compute[72441]:   </clock>
Aug 09 19:40:48 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:40:48 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:40:48 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:40:48 user nova-compute[72441]:   </cpu>
Aug 09 19:40:48 user nova-compute[72441]:   <devices>
Aug 09 19:40:48 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:40:48 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:40:48 user nova-compute[72441]:       <source dev="/dev/sde"/>
Aug 09 19:40:48 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:40:48 user nova-compute[72441]:       <serial>547c3d8c-2856-4034-9fd0-766d6d9db408</serial>
Aug 09 19:40:48 user nova-compute[72441]:     </disk>
Aug 09 19:40:48 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:40:48 user nova-compute[72441]:       <mac address="fa:16:3e:d1:de:98"/>
Aug 09 19:40:48 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:40:48 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:40:48 user nova-compute[72441]:       <target dev="tap7f1f2da4-89"/>
Aug 09 19:40:48 user nova-compute[72441]:     </interface>
Aug 09 19:40:48 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:40:48 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc/console.log" append="off"/>
Aug 09 19:40:48 user nova-compute[72441]:     </serial>
Aug 09 19:40:48 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:40:48 user nova-compute[72441]:     <video>
Aug 09 19:40:48 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:40:48 user nova-compute[72441]:     </video>
Aug 09 19:40:48 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:40:48 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:40:48 user nova-compute[72441]:     </rng>
Aug 09 19:40:48 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:40:48 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:40:48 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:40:48 user nova-compute[72441]:     </memballoon>
Aug 09 19:40:48 user nova-compute[72441]:   </devices>
Aug 09 19:40:48 user nova-compute[72441]: </domain>
Aug 09 19:40:48 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-414112240',display_name='tempest-TestShelveInstance-server-414112240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-414112240',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZFx7vZ5g5Xen3WE00to5BL9o7dbKBges/p9HSNvs37OMnEXgnyF9biWsRr8qexSO+Gup2ZURrb1zRWsHzw+i+hcXKTtkbYh1emOpx8kjwLEw8uoZDUv9Z4cSzoCBfAlA==',key_name='tempest-TestShelveInstance-595052958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff19d044abd840ab98dac7fe1e20ddc3',ramdisk_id='',reservation_id='r-ynxt8uc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1365792064',owner_user_name='tempest-TestShelveInstance-1365792064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:40:31Z,user_data=None,user_id='cb23b737f92a4b638b43ea8a1d195a5e',uuid=5b0b69c2-28a7-444f-84ab-f47d63235dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converting VIF {"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG os_vif [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f1f2da4-89, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f1f2da4-89, col_values=(('external_ids', {'iface-id': '7f1f2da4-8966-4874-8261-8324c96e8257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:de:98', 'vm-uuid': '5b0b69c2-28a7-444f-84ab-f47d63235dbc'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:48 user nova-compute[72441]: INFO os_vif [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89')
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:40:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] No VIF found with MAC fa:16:3e:d1:de:98, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:40:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-0ba84e96-8dc9-4878-84dd-b8ba5e793910 req-9b70e087-b568-4d79-ab3f-21e41db35ab2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0ba84e96-8dc9-4878-84dd-b8ba5e793910 req-9b70e087-b568-4d79-ab3f-21e41db35ab2 service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0ba84e96-8dc9-4878-84dd-b8ba5e793910 req-9b70e087-b568-4d79-ab3f-21e41db35ab2 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0ba84e96-8dc9-4878-84dd-b8ba5e793910 req-9b70e087-b568-4d79-ab3f-21e41db35ab2 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-0ba84e96-8dc9-4878-84dd-b8ba5e793910 req-9b70e087-b568-4d79-ab3f-21e41db35ab2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:50 user nova-compute[72441]: WARNING nova.compute.manager [req-0ba84e96-8dc9-4878-84dd-b8ba5e793910 req-9b70e087-b568-4d79-ab3f-21e41db35ab2 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state building and task_state spawning.
Aug 09 19:40:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610052.0846372, 5b0b69c2-28a7-444f-84ab-f47d63235dbc => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] VM Resumed (Lifecycle Event)
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance spawned successfully.
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610052.085733, 5b0b69c2-28a7-444f-84ab-f47d63235dbc => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] VM Started (Lifecycle Event)
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Took 5.09 seconds to spawn the instance on the hypervisor.
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-a567b60a-fa9e-406e-b53d-69ee543b056e req-78fd3ba2-2234-4d19-a944-80acca44f291 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a567b60a-fa9e-406e-b53d-69ee543b056e req-78fd3ba2-2234-4d19-a944-80acca44f291 service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a567b60a-fa9e-406e-b53d-69ee543b056e req-78fd3ba2-2234-4d19-a944-80acca44f291 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a567b60a-fa9e-406e-b53d-69ee543b056e req-78fd3ba2-2234-4d19-a944-80acca44f291 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-a567b60a-fa9e-406e-b53d-69ee543b056e req-78fd3ba2-2234-4d19-a944-80acca44f291 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:52 user nova-compute[72441]: WARNING nova.compute.manager [req-a567b60a-fa9e-406e-b53d-69ee543b056e req-78fd3ba2-2234-4d19-a944-80acca44f291 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state building and task_state spawning.
Aug 09 19:40:52 user nova-compute[72441]: INFO nova.compute.manager [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Took 21.89 seconds to build instance.
Aug 09 19:40:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fccfa02d-ae86-4d18-93ec-078198fb0e07 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:53 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:57 user nova-compute[72441]: INFO nova.compute.manager [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Unrescuing
Aug 09 19:40:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'flavor' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-00e76f4b-2a76-40b9-98e0-d7da05e58e3a req-bb75d2c5-300d-4b7a-9114-716c1460a513 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-00e76f4b-2a76-40b9-98e0-d7da05e58e3a req-bb75d2c5-300d-4b7a-9114-716c1460a513 service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-00e76f4b-2a76-40b9-98e0-d7da05e58e3a req-bb75d2c5-300d-4b7a-9114-716c1460a513 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-00e76f4b-2a76-40b9-98e0-d7da05e58e3a req-bb75d2c5-300d-4b7a-9114-716c1460a513 service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-00e76f4b-2a76-40b9-98e0-d7da05e58e3a req-bb75d2c5-300d-4b7a-9114-716c1460a513 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:40:59 user nova-compute[72441]: WARNING nova.compute.manager [req-00e76f4b-2a76-40b9-98e0-d7da05e58e3a req-bb75d2c5-300d-4b7a-9114-716c1460a513 service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:40:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-changed-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing instance network info cache due to event network-changed-77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG nova.network.neutron [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:40:59 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance destroyed successfully.
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updated VIF entry in instance network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG nova.network.neutron [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cb7eb9fa-8ad3-42b8-a449-634fce8011cf req-4c88992b-7127-462c-9e56-88b1d69332bc service nova] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-27cc8c19-7bbd-4dbc-9f1b-76a4e3e6f249 req-9721bb51-0f91-4684-915c-7ec38c2c86da service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-27cc8c19-7bbd-4dbc-9f1b-76a4e3e6f249 req-9721bb51-0f91-4684-915c-7ec38c2c86da service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-27cc8c19-7bbd-4dbc-9f1b-76a4e3e6f249 req-9721bb51-0f91-4684-915c-7ec38c2c86da service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-27cc8c19-7bbd-4dbc-9f1b-76a4e3e6f249 req-9721bb51-0f91-4684-915c-7ec38c2c86da service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-27cc8c19-7bbd-4dbc-9f1b-76a4e3e6f249 req-9721bb51-0f91-4684-915c-7ec38c2c86da service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:01 user nova-compute[72441]: WARNING nova.compute.manager [req-27cc8c19-7bbd-4dbc-9f1b-76a4e3e6f249 req-9721bb51-0f91-4684-915c-7ec38c2c86da service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:41:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-changed-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing instance network info cache due to event network-changed-77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] Acquiring lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] Acquired lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG nova.network.neutron [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Refreshing network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updated VIF entry in instance network info cache for port 77342bf2-a694-45b5-a931-061d51a3f226. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:41:02 user nova-compute[72441]: DEBUG nova.network.neutron [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [{"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:41:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a577552d-3018-41c6-85db-91e35c6e0144 req-d823f72b-8b22-40b7-92ad-68b8dc9c8bba service nova] Releasing lock "refresh_cache-1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:03 user nova-compute[72441]: WARNING nova.compute.manager [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:03 user nova-compute[72441]: WARNING nova.compute.manager [req-cc4b1df8-e4d9-4177-8f07-83d734f96e68 req-5926cbba-2223-4cd7-8571-175a14368f3c service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state rescued and task_state unrescuing.
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Removed pending event for 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 due to event {{(pid=72441) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610063.4605818, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:41:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Resumed (Lifecycle Event)
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-5be3eeb4-3b62-4dbd-9949-e6750e8c6d7f tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:41:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610063.467341, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:41:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Started (Lifecycle Event)
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:41:03 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:41:04 user nova-compute[72441]: INFO nova.compute.claims [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Claim successful on node user
Aug 09 19:41:04 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:05 user nova-compute[72441]: INFO nova.compute.manager [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Detaching volume aaa5cd57-c2b9-44af-b142-ffb570195aa6
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:41:05 user nova-compute[72441]: INFO nova.virt.block_device [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Attempting to driver detach volume aaa5cd57-c2b9-44af-b142-ffb570195aa6 from mountpoint /dev/vdb
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Attempting to detach device vdb from instance c004c872-c398-4e9c-867d-e9d1cddf4735 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:41:05 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:41:05 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:41:05 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:41:05 user nova-compute[72441]:   <serial>aaa5cd57-c2b9-44af-b142-ffb570195aa6</serial>
Aug 09 19:41:05 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:41:05 user nova-compute[72441]: </disk>
Aug 09 19:41:05 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:41:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:41:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully detached device vdb from instance c004c872-c398-4e9c-867d-e9d1cddf4735 from the persistent domain config.
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c004c872-c398-4e9c-867d-e9d1cddf4735 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:41:05 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:41:05 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:41:05 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:41:05 user nova-compute[72441]:   <serial>aaa5cd57-c2b9-44af-b142-ffb570195aa6</serial>
Aug 09 19:41:05 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 19:41:05 user nova-compute[72441]: </disk>
Aug 09 19:41:05 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.policy [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '523ae2e0c78f4b289d9633deea37011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61244bcc605b44c393b346ad4c7ff324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:41:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Creating image(s)
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "/opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "/opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.146s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610065.6305566, c004c872-c398-4e9c-867d-e9d1cddf4735 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:41:05 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully detached device vdb from instance c004c872-c398-4e9c-867d-e9d1cddf4735 from the live domain config.
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.225s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBVbMpkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:41:05 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cecc3-c169-40ba-bec0-801618d7f80e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk 1073741824" returned: 0 in 0.060s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5895a689-6160-4f21-8f5c-565c2547bcdc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:41:05 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9021f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a7f84-546c-46ec-aa38-9471adb98e60]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4207154-567c-49c4-ae01-ef8f1674a889]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265d9ae-cbae-48d7-ae7a-1ac2a12658d4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.175s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Successfully created port: f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[818506b5-40dc-4dec-acef-25f5e48ebc3a]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7604d53f-f316-4eb1-83fe-5d6a8f2f8724]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:05 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Cannot resize image /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lazy-loading 'migration_context' on Instance uuid 6b04a9f9-5403-443c-99f5-122bb3d2d117 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c795c383-5b10-4da9-88c7-54db2e91889f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260]
Aug 09 19:41:06 user nova-compute[72441]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6, portal: 172.16.0.220,3260] successful.
Aug 09 19:41:06 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Ensure instance console log exists: /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa5cd57-c2b9-44af-b142-ffb570195aa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf14c77-45bd-4c3c-9f78-174498c6b424]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== disconnect_volume: return (452ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Successfully updated port: f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-changed-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Refreshing instance network info cache due to event network-changed-f546cb1e-58f8-4690-ad3d-0e07e9175ca2. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] Acquiring lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] Acquired lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Refreshing network info cache for port f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:41:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.neutron [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-590a1f5c-ad08-4914-81f0-06ed99948fda req-c6d34e35-9440-4359-9b0e-a5b19d990225 service nova] Releasing lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquired lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-50535d4e-7acf-4bc6-83dc-2cc518a362d1 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.110s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72441) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Releasing lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Instance network_info: |[{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Start _get_guest_xml network_info=[{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:41:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:41:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1759903287',display_name='tempest-ServersNegativeTestJSON-server-1759903287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1759903287',id=44,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61244bcc605b44c393b346ad4c7ff324',ramdisk_id='',reservation_id='r-utkhq481',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957430953',owner_user_name='tempest-ServersNegativeTestJSON-957430953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:41:05Z,user_data=None,user_id='523ae2e0c78f4b289d9633deea37011c',uuid=6b04a9f9-5403-443c-99f5-122bb3d2d117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converting VIF {"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.objects.instance [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b04a9f9-5403-443c-99f5-122bb3d2d117 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:41:07 user nova-compute[72441]:   <uuid>6b04a9f9-5403-443c-99f5-122bb3d2d117</uuid>
Aug 09 19:41:07 user nova-compute[72441]:   <name>instance-0000002c</name>
Aug 09 19:41:07 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:41:07 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:41:07 user nova-compute[72441]:   <metadata>
Aug 09 19:41:07 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:41:07 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:41:07 user nova-compute[72441]:       <nova:name>tempest-ServersNegativeTestJSON-server-1759903287</nova:name>
Aug 09 19:41:07 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:41:07</nova:creationTime>
Aug 09 19:41:07 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:41:07 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:41:07 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:41:07 user nova-compute[72441]:       <nova:owner>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:user uuid="523ae2e0c78f4b289d9633deea37011c">tempest-ServersNegativeTestJSON-957430953-project-member</nova:user>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:project uuid="61244bcc605b44c393b346ad4c7ff324">tempest-ServersNegativeTestJSON-957430953</nova:project>
Aug 09 19:41:07 user nova-compute[72441]:       </nova:owner>
Aug 09 19:41:07 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:41:07 user nova-compute[72441]:       <nova:ports>
Aug 09 19:41:07 user nova-compute[72441]:         <nova:port uuid="f546cb1e-58f8-4690-ad3d-0e07e9175ca2">
Aug 09 19:41:07 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 19:41:07 user nova-compute[72441]:         </nova:port>
Aug 09 19:41:07 user nova-compute[72441]:       </nova:ports>
Aug 09 19:41:07 user nova-compute[72441]:     </nova:instance>
Aug 09 19:41:07 user nova-compute[72441]:   </metadata>
Aug 09 19:41:07 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:41:07 user nova-compute[72441]:     <system>
Aug 09 19:41:07 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:41:07 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:41:07 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:41:07 user nova-compute[72441]:       <entry name="serial">6b04a9f9-5403-443c-99f5-122bb3d2d117</entry>
Aug 09 19:41:07 user nova-compute[72441]:       <entry name="uuid">6b04a9f9-5403-443c-99f5-122bb3d2d117</entry>
Aug 09 19:41:07 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:41:07 user nova-compute[72441]:     </system>
Aug 09 19:41:07 user nova-compute[72441]:   </sysinfo>
Aug 09 19:41:07 user nova-compute[72441]:   <os>
Aug 09 19:41:07 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:41:07 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:41:07 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:41:07 user nova-compute[72441]:   </os>
Aug 09 19:41:07 user nova-compute[72441]:   <features>
Aug 09 19:41:07 user nova-compute[72441]:     <acpi/>
Aug 09 19:41:07 user nova-compute[72441]:     <apic/>
Aug 09 19:41:07 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:41:07 user nova-compute[72441]:   </features>
Aug 09 19:41:07 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:41:07 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:41:07 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:41:07 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:41:07 user nova-compute[72441]:   </clock>
Aug 09 19:41:07 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:41:07 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:41:07 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:41:07 user nova-compute[72441]:   </cpu>
Aug 09 19:41:07 user nova-compute[72441]:   <devices>
Aug 09 19:41:07 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:41:07 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:41:07 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk"/>
Aug 09 19:41:07 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:41:07 user nova-compute[72441]:     </disk>
Aug 09 19:41:07 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:41:07 user nova-compute[72441]:       <mac address="fa:16:3e:26:ec:1c"/>
Aug 09 19:41:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:41:07 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:41:07 user nova-compute[72441]:       <target dev="tapf546cb1e-58"/>
Aug 09 19:41:07 user nova-compute[72441]:     </interface>
Aug 09 19:41:07 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:41:07 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/console.log" append="off"/>
Aug 09 19:41:07 user nova-compute[72441]:     </serial>
Aug 09 19:41:07 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:41:07 user nova-compute[72441]:     <video>
Aug 09 19:41:07 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:41:07 user nova-compute[72441]:     </video>
Aug 09 19:41:07 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:41:07 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:41:07 user nova-compute[72441]:     </rng>
Aug 09 19:41:07 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:41:07 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:41:07 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:41:07 user nova-compute[72441]:     </memballoon>
Aug 09 19:41:07 user nova-compute[72441]:   </devices>
Aug 09 19:41:07 user nova-compute[72441]: </domain>
Aug 09 19:41:07 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1759903287',display_name='tempest-ServersNegativeTestJSON-server-1759903287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1759903287',id=44,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61244bcc605b44c393b346ad4c7ff324',ramdisk_id='',reservation_id='r-utkhq481',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957430953',owner_user_name='tempest-ServersNegativeTestJSON-957430953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:41:05Z,user_data=None,user_id='523ae2e0c78f4b289d9633deea37011c',uuid=6b04a9f9-5403-443c-99f5-122bb3d2d117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converting VIF {"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG os_vif [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf546cb1e-58, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf546cb1e-58, col_values=(('external_ids', {'iface-id': 'f546cb1e-58f8-4690-ad3d-0e07e9175ca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ec:1c', 'vm-uuid': '6b04a9f9-5403-443c-99f5-122bb3d2d117'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:07 user nova-compute[72441]: INFO os_vif [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58')
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-d888fca5-6ce7-4ebb-be80-ed86c55592cc req-03ac3442-99c6-4dfe-b527-ffd0a8d3cbd6 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d888fca5-6ce7-4ebb-be80-ed86c55592cc req-03ac3442-99c6-4dfe-b527-ffd0a8d3cbd6 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d888fca5-6ce7-4ebb-be80-ed86c55592cc req-03ac3442-99c6-4dfe-b527-ffd0a8d3cbd6 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d888fca5-6ce7-4ebb-be80-ed86c55592cc req-03ac3442-99c6-4dfe-b527-ffd0a8d3cbd6 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.compute.manager [req-d888fca5-6ce7-4ebb-be80-ed86c55592cc req-03ac3442-99c6-4dfe-b527-ffd0a8d3cbd6 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:07 user nova-compute[72441]: WARNING nova.compute.manager [req-d888fca5-6ce7-4ebb-be80-ed86c55592cc req-03ac3442-99c6-4dfe-b527-ffd0a8d3cbd6 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state active and task_state powering-off.
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:41:07 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] No VIF found with MAC fa:16:3e:26:ec:1c, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:41:08 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance destroyed successfully.
Aug 09 19:41:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-277ee2e8-73b3-46e2-893a-28b878c96a5f tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.383s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-e247dafb-9622-4c08-8407-6b0377bab2ea req-da4f2d2f-9c17-4786-bbb3-ac961b3e2642 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e247dafb-9622-4c08-8407-6b0377bab2ea req-da4f2d2f-9c17-4786-bbb3-ac961b3e2642 service nova] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e247dafb-9622-4c08-8407-6b0377bab2ea req-da4f2d2f-9c17-4786-bbb3-ac961b3e2642 service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e247dafb-9622-4c08-8407-6b0377bab2ea req-da4f2d2f-9c17-4786-bbb3-ac961b3e2642 service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-e247dafb-9622-4c08-8407-6b0377bab2ea req-da4f2d2f-9c17-4786-bbb3-ac961b3e2642 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] No waiting events found dispatching network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:09 user nova-compute[72441]: WARNING nova.compute.manager [req-e247dafb-9622-4c08-8407-6b0377bab2ea req-da4f2d2f-9c17-4786-bbb3-ac961b3e2642 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received unexpected event network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 for instance with vm_state building and task_state spawning.
Aug 09 19:41:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-e080bead-7952-4019-a933-d3609f13b788 req-aa47fe2d-42cf-4a25-af5c-cfe1ef43e77d service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e080bead-7952-4019-a933-d3609f13b788 req-aa47fe2d-42cf-4a25-af5c-cfe1ef43e77d service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e080bead-7952-4019-a933-d3609f13b788 req-aa47fe2d-42cf-4a25-af5c-cfe1ef43e77d service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e080bead-7952-4019-a933-d3609f13b788 req-aa47fe2d-42cf-4a25-af5c-cfe1ef43e77d service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-e080bead-7952-4019-a933-d3609f13b788 req-aa47fe2d-42cf-4a25-af5c-cfe1ef43e77d service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:09 user nova-compute[72441]: WARNING nova.compute.manager [req-e080bead-7952-4019-a933-d3609f13b788 req-aa47fe2d-42cf-4a25-af5c-cfe1ef43e77d service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state stopped and task_state None.
Aug 09 19:41:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610071.5460162, 6b04a9f9-5403-443c-99f5-122bb3d2d117 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] VM Resumed (Lifecycle Event)
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Instance spawned successfully.
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610071.547237, 6b04a9f9-5403-443c-99f5-122bb3d2d117 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] VM Started (Lifecycle Event)
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-efb5bb58-ecd4-457c-a5c9-b3ba58bd7be1 req-1a6f6222-7d91-433c-be1b-ce272fe793c5 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-efb5bb58-ecd4-457c-a5c9-b3ba58bd7be1 req-1a6f6222-7d91-433c-be1b-ce272fe793c5 service nova] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-efb5bb58-ecd4-457c-a5c9-b3ba58bd7be1 req-1a6f6222-7d91-433c-be1b-ce272fe793c5 service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-efb5bb58-ecd4-457c-a5c9-b3ba58bd7be1 req-1a6f6222-7d91-433c-be1b-ce272fe793c5 service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-efb5bb58-ecd4-457c-a5c9-b3ba58bd7be1 req-1a6f6222-7d91-433c-be1b-ce272fe793c5 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] No waiting events found dispatching network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:41:11 user nova-compute[72441]: WARNING nova.compute.manager [req-efb5bb58-ecd4-457c-a5c9-b3ba58bd7be1 req-1a6f6222-7d91-433c-be1b-ce272fe793c5 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received unexpected event network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 for instance with vm_state building and task_state spawning.
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 09 19:41:11 user nova-compute[72441]: DEBUG nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:41:11 user nova-compute[72441]: INFO nova.compute.manager [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Took 7.13 seconds to build instance.
Aug 09 19:41:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-58e68d2b-41fa-48a3-9d1d-81a96d4c9d1a tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.298s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:23 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610068.6637235, c004c872-c398-4e9c-867d-e9d1cddf4735 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:41:23 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Stopped (Lifecycle Event)
Aug 09 19:41:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-07107b4a-aab0-4a53-91e9-5c209b7ba83e None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:41:23 user nova-compute[72441]: DEBUG nova.compute.manager [None req-07107b4a-aab0-4a53-91e9-5c209b7ba83e None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:41:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Detaching volume 36f6cfba-a6d6-490c-913f-e93ead9ea030
Aug 09 19:41:31 user nova-compute[72441]: INFO nova.virt.block_device [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Attempting to driver detach volume 36f6cfba-a6d6-490c-913f-e93ead9ea030 from mountpoint /dev/vdb
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Attempting to detach device vdb from instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:41:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:41:31 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:41:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:41:31 user nova-compute[72441]:   <serial>36f6cfba-a6d6-490c-913f-e93ead9ea030</serial>
Aug 09 19:41:31 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:41:31 user nova-compute[72441]: </disk>
Aug 09 19:41:31 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:41:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Successfully detached device vdb from instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 from the persistent domain config.
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:41:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:41:31 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:41:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:41:31 user nova-compute[72441]:   <serial>36f6cfba-a6d6-490c-913f-e93ead9ea030</serial>
Aug 09 19:41:31 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:41:31 user nova-compute[72441]: </disk>
Aug 09 19:41:31 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610091.9007733, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:41:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Successfully detached device vdb from instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 from the live domain config.
Aug 09 19:41:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlcIUzVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:41:31 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae9320-2596-4fc1-a90f-2679d859bd48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cfad76-1942-423d-9e54-a8928362b11a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:41:31 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:41:31 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:41:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 (non-flash)
Aug 09 19:41:31 user nova-compute[72441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:41:31 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:41:31 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984fecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8defc-ecb4-4883-bdf1-40efb6ebdf1e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:31 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d7706b-a293-4ada-b1a1-c18e7bf37d27]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a88d8b-5394-4237-8c02-c81c371cb013]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e9910-591b-4bf1-8baa-b2a81930fecc]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e20f86-c504-49ff-9d03-be0ceb23d3b7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd8c24-f617-4706-93c9-c98a108c7e10]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260]
Aug 09 19:41:32 user nova-compute[72441]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030, portal: 172.16.0.220,3260] successful.
Aug 09 19:41:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36f6cfba-a6d6-490c-913f-e93ead9ea030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1d51d3-d9bf-4e61-882e-0b8426e202e4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] <== disconnect_volume: return (282ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'flavor' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:41:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6776d2d1-6892-400d-b42a-b0fb7a484050 tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:41:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:41:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:41:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:41:44 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:41:44 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:41:44 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8105MB free_disk=25.066532135009766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:41:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 5b0b69c2-28a7-444f-84ab-f47d63235dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:41:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:41:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:41:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:41:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:41:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-changed-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG nova.compute.manager [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Refreshing instance network info cache due to event network-changed-3d5b27e5-9667-4491-bae9-436a54847c46. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] Acquiring lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] Acquired lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG nova.network.neutron [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Refreshing network info cache for port 3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG nova.network.neutron [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updated VIF entry in instance network info cache for port 3d5b27e5-9667-4491-bae9-436a54847c46. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG nova.network.neutron [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updating instance_info_cache with network_info: [{"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7ea18659-76a9-46ed-9221-568312e7ed6c req-d4fc20a4-0fcb-4097-aaad-4b75846c7bd4 service nova] Releasing lock "refresh_cache-4a0e3f0f-525d-4414-9430-e7dd01cf2c67" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:21 user nova-compute[72441]: INFO nova.compute.manager [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Terminating instance
Aug 09 19:42:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:22 user nova-compute[72441]: INFO nova.compute.manager [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Terminating instance
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-b4a144f1-8e6e-4d84-91cb-9bcaa07138d0 req-8302474f-af54-4687-9024-82aa18e361d0 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-vif-unplugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b4a144f1-8e6e-4d84-91cb-9bcaa07138d0 req-8302474f-af54-4687-9024-82aa18e361d0 service nova] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b4a144f1-8e6e-4d84-91cb-9bcaa07138d0 req-8302474f-af54-4687-9024-82aa18e361d0 service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b4a144f1-8e6e-4d84-91cb-9bcaa07138d0 req-8302474f-af54-4687-9024-82aa18e361d0 service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-b4a144f1-8e6e-4d84-91cb-9bcaa07138d0 req-8302474f-af54-4687-9024-82aa18e361d0 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] No waiting events found dispatching network-vif-unplugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-b4a144f1-8e6e-4d84-91cb-9bcaa07138d0 req-8302474f-af54-4687-9024-82aa18e361d0 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-vif-unplugged-3d5b27e5-9667-4491-bae9-436a54847c46 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing instance network info cache due to event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:22 user nova-compute[72441]: DEBUG nova.network.neutron [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Instance destroyed successfully.
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'resources' on Instance uuid 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Instance destroyed successfully.
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lazy-loading 'resources' on Instance uuid 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-696001244',display_name='tempest-TestVolumeBootPattern-server-696001244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-696001244',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-bqaq6ayi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:40:46Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=4a0e3f0f-525d-4414-9430-e7dd01cf2c67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "3d5b27e5-9667-4491-bae9-436a54847c46", "address": "fa:16:3e:c1:a5:2d", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5b27e5-96", "ovs_interfaceid": "3d5b27e5-9667-4491-bae9-436a54847c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_vif [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264463955',display_name='tempest-ServerStableDeviceRescueTest-server-264463955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264463955',id=39,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHy1xInRStakLW2kSTF45qNLLvigbDkWhk0iPsV05izR1oVogWt91j/ZWosGznSob3kCMZUTIBWEasgiyWakDo38XUYqHDIBIK8Poqu8os185qpeMp83rUzZ6CUsUZ29A==',key_name='tempest-keypair-1862592562',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af13c3a40844c4d8d5118297e700385',ramdisk_id='',reservation_id='r-0hsa0nn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-449243577',owner_user_name='tempest-ServerStableDeviceRescueTest-449243577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7bd4f65ca8a4bd4aedd651a92fe5a19',uuid=1df1084d-ed05-4f3f-aad5-f8d57be3b0f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converting VIF {"id": "77342bf2-a694-45b5-a931-061d51a3f226", "address": "fa:16:3e:e3:6e:3d", "network": {"id": "cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1558700592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af13c3a40844c4d8d5118297e700385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77342bf2-a6", "ovs_interfaceid": "77342bf2-a694-45b5-a931-061d51a3f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_vif [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d5b27e5-96, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77342bf2-a6, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: INFO os_vif [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:a5:2d,bridge_name='br-int',has_traffic_filtering=True,id=3d5b27e5-9667-4491-bae9-436a54847c46,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5b27e5-96')
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:42:23 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: INFO os_vif [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:6e:3d,bridge_name='br-int',has_traffic_filtering=True,id=77342bf2-a694-45b5-a931-061d51a3f226,network=Network(cfe75a2c-bfc2-483f-8e08-b45bdd0c0e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77342bf2-a6')
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Deleting instance files /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6_del
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Deletion of /opt/stack/data/nova/instances/1df1084d-ed05-4f3f-aad5-f8d57be3b0f6_del complete
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e06635-7efb-494a-af09-be7c1ec0f3f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dbcd21-0768-4940-9705-2ea4cd8529a6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:42:23 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:42:23 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:42:23 user nova-compute[72441]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:42:23 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d068fe9-53d8-48ee-9907-f2577008674a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.compute.manager [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a4bce-fb05-4b6d-abe7-0338e7c4001d]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd976ef-0095-4a1d-a41c-fd208ade210b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ec575c-d6d7-4341-a27c-3446fb79a249]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[53129d11-ec06-4e64-bf45-f3bf69ce9dc9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fb72b3-0109-4881-8bf4-6f40001f6fcc]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]
Aug 09 19:42:23 user nova-compute[72441]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.
Aug 09 19:42:23 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e366a6ac-ec9a-455f-b7cc-30ed660fa3e9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== disconnect_volume: return (287ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Deleting instance files /opt/stack/data/nova/instances/4a0e3f0f-525d-4414-9430-e7dd01cf2c67_del
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Deletion of /opt/stack/data/nova/instances/4a0e3f0f-525d-4414-9430-e7dd01cf2c67_del complete
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.compute.manager [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updated VIF entry in instance network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG nova.network.neutron [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5090e8d0-c5f7-4cd7-bee9-e92c33a74dac req-4bf64c2e-82f3-4a31-973c-49b80eb787d4 service nova] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:23 user nova-compute[72441]: INFO nova.compute.manager [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Shelve offloading
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:24 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance destroyed successfully.
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:42:24 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Took 1.15 seconds to deallocate network for instance.
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Acquiring lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] No waiting events found dispatching network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:24 user nova-compute[72441]: WARNING nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received unexpected event network-vif-plugged-3d5b27e5-9667-4491-bae9-436a54847c46 for instance with vm_state active and task_state deleting.
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-unplugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Acquiring lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] No waiting events found dispatching network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:24 user nova-compute[72441]: WARNING nova.compute.manager [req-414147c8-5fe6-45a2-93a9-3dcd36d604a7 req-88b8a7fa-300e-4c3c-a5e2-12ec7116ceef service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received unexpected event network-vif-plugged-77342bf2-a694-45b5-a931-061d51a3f226 for instance with vm_state active and task_state deleting.
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:24 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Deleted allocations for instance 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:24 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Took 1.41 seconds to deallocate network for instance.
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-69d11ae4-fe25-4253-a350-61dadaeb7c4a req-2cddaf81-cec0-4315-881c-e5fb469e1748 service nova] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Received event network-vif-deleted-3d5b27e5-9667-4491-bae9-436a54847c46 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-437627d7-30c2-419c-a9d5-42424831ff5b tempest-ServerStableDeviceRescueTest-449243577 tempest-ServerStableDeviceRescueTest-449243577-project-member] Lock "1df1084d-ed05-4f3f-aad5-f8d57be3b0f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-unplugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-unplugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:25 user nova-compute[72441]: WARNING nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-unplugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state active and task_state shelving.
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Received event network-vif-deleted-77342bf2-a694-45b5-a931-061d51a3f226 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:25 user nova-compute[72441]: WARNING nova.compute.manager [req-534d394e-7af0-4fed-8089-ca1358a558ed req-d9c17393-51ae-4158-b8d8-660424bd89bb service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state active and task_state shelving.
Aug 09 19:42:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance destroyed successfully.
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'resources' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:25 user nova-compute[72441]: INFO nova.compute.manager [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-414112240',display_name='tempest-TestShelveInstance-server-414112240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-414112240',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZFx7vZ5g5Xen3WE00to5BL9o7dbKBges/p9HSNvs37OMnEXgnyF9biWsRr8qexSO+Gup2ZURrb1zRWsHzw+i+hcXKTtkbYh1emOpx8kjwLEw8uoZDUv9Z4cSzoCBfAlA==',key_name='tempest-TestShelveInstance-595052958',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff19d044abd840ab98dac7fe1e20ddc3',ramdisk_id='',reservation_id='r-ynxt8uc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1365792064',owner_user_name='tempest-TestShelveInstance-1365792064-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:40:52Z,user_data=None,user_id='cb23b737f92a4b638b43ea8a1d195a5e',uuid=5b0b69c2-28a7-444f-84ab-f47d63235dbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converting VIF {"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_vif [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f1f2da4-89, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:25 user nova-compute[72441]: INFO os_vif [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89')
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:42:25 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f18f6a1-952b-42b6-a023-96a60f70b1e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32a646-7d90-476e-bc6f-6f61ecef5210]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:42:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:42:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90592170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'): ({'sde'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Removing single pathed devices sde {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d71b1-c3b8-4e40-a27d-2ff06163431f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b560587e-c620-44d4-859e-c6b0ef5a0ac4]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Flushing IO for device /dev/sde {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[395ca0c8-3b87-452b-b010-7dff72e648a6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c6fac7-9743-4f92-92e3-f59b9258db30]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] SCSI volumes sde have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0111d8b5-5ccc-4de2-84a0-b4a501c5c89e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:25 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Deleted allocations for instance 4a0e3f0f-525d-4414-9430-e7dd01cf2c67
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[beabe4ac-ccf8-4420-9b4e-4e0d7798d3da]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]
Aug 09 19:42:25 user nova-compute[72441]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.
Aug 09 19:42:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b386b-2bca-47b5-857c-f9d3b359bb0e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] <== disconnect_volume: return (279ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:42:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:42:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Deleting instance files /opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc_del
Aug 09 19:42:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Deletion of /opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc_del complete
Aug 09 19:42:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a351d46c-30a1-41dc-b5df-9d1338ed9c49 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "4a0e3f0f-525d-4414-9430-e7dd01cf2c67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.069s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:26 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Deleted allocations for instance 5b0b69c2-28a7-444f-84ab-f47d63235dbc
Aug 09 19:42:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing instance network info cache due to event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6ade67f5-4879-4326-a1df-686284451008 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.562s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updated VIF entry in instance network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG nova.network.neutron [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": null, "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-080f5e90-7013-45cf-83f7-46dc32ac6f36 req-412a96cd-0727-4b97-981c-fe1ffb592baa service nova] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:38 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610143.0301185, 4a0e3f0f-525d-4414-9430-e7dd01cf2c67 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:42:38 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] VM Stopped (Lifecycle Event)
Aug 09 19:42:38 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610143.0370686, 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:42:38 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] VM Stopped (Lifecycle Event)
Aug 09 19:42:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-65349400-c558-4d0c-aece-6232441ef630 None None] [instance: 4a0e3f0f-525d-4414-9430-e7dd01cf2c67] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:42:38 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4665f3de-e4c6-4470-97c0-1955e8d28fb1 None None] [instance: 1df1084d-ed05-4f3f-aad5-f8d57be3b0f6] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:42:39 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610144.3338213, 5b0b69c2-28a7-444f-84ab-f47d63235dbc => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:42:39 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] VM Stopped (Lifecycle Event)
Aug 09 19:42:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-401645c5-771f-4b30-b46d-57b2b572685c None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:42:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:42:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:42:43 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:42:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:45 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:42:45 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:42:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=25.182666778564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:42:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:42:46 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:42:46 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:42:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:42:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:42:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:42:55 user nova-compute[72441]: INFO nova.compute.claims [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Claim successful on node user
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:42:55 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:42:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.policy [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '523ae2e0c78f4b289d9633deea37011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61244bcc605b44c393b346ad4c7ff324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:42:55 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Creating image(s)
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "/opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "/opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk 1073741824" returned: 0 in 0.052s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Successfully created port: 6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Cannot resize image /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lazy-loading 'migration_context' on Instance uuid 9f3857fe-1bdc-438d-abff-c07b562e6ede {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Ensure instance console log exists: /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Successfully updated port: 6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "refresh_cache-9f3857fe-1bdc-438d-abff-c07b562e6ede" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquired lock "refresh_cache-9f3857fe-1bdc-438d-abff-c07b562e6ede" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-changed-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.compute.manager [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Refreshing instance network info cache due to event network-changed-6aecb383-a829-4a33-8310-5e923afb07e5. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] Acquiring lock "refresh_cache-9f3857fe-1bdc-438d-abff-c07b562e6ede" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Updating instance_info_cache with network_info: [{"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Releasing lock "refresh_cache-9f3857fe-1bdc-438d-abff-c07b562e6ede" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Instance network_info: |[{"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] Acquired lock "refresh_cache-9f3857fe-1bdc-438d-abff-c07b562e6ede" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.neutron [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Refreshing network info cache for port 6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Start _get_guest_xml network_info=[{"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:42:57 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:42:57 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:42:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1337116267',display_name='tempest-ServersNegativeTestJSON-server-1337116267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1337116267',id=45,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61244bcc605b44c393b346ad4c7ff324',ramdisk_id='',reservation_id='r-dnunoa0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957430953',owner_user_name='tempest-ServersNegativeTestJSON-957430953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:42:56Z,user_data=None,user_id='523ae2e0c78f4b289d9633deea37011c',uuid=9f3857fe-1bdc-438d-abff-c07b562e6ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converting VIF {"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.objects.instance [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f3857fe-1bdc-438d-abff-c07b562e6ede {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:42:57 user nova-compute[72441]:   <uuid>9f3857fe-1bdc-438d-abff-c07b562e6ede</uuid>
Aug 09 19:42:57 user nova-compute[72441]:   <name>instance-0000002d</name>
Aug 09 19:42:57 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:42:57 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:42:57 user nova-compute[72441]:   <metadata>
Aug 09 19:42:57 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:42:57 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:42:57 user nova-compute[72441]:       <nova:name>tempest-ServersNegativeTestJSON-server-1337116267</nova:name>
Aug 09 19:42:57 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:42:57</nova:creationTime>
Aug 09 19:42:57 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:42:57 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:42:57 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:42:57 user nova-compute[72441]:       <nova:owner>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:user uuid="523ae2e0c78f4b289d9633deea37011c">tempest-ServersNegativeTestJSON-957430953-project-member</nova:user>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:project uuid="61244bcc605b44c393b346ad4c7ff324">tempest-ServersNegativeTestJSON-957430953</nova:project>
Aug 09 19:42:57 user nova-compute[72441]:       </nova:owner>
Aug 09 19:42:57 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:42:57 user nova-compute[72441]:       <nova:ports>
Aug 09 19:42:57 user nova-compute[72441]:         <nova:port uuid="6aecb383-a829-4a33-8310-5e923afb07e5">
Aug 09 19:42:57 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 19:42:57 user nova-compute[72441]:         </nova:port>
Aug 09 19:42:57 user nova-compute[72441]:       </nova:ports>
Aug 09 19:42:57 user nova-compute[72441]:     </nova:instance>
Aug 09 19:42:57 user nova-compute[72441]:   </metadata>
Aug 09 19:42:57 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:42:57 user nova-compute[72441]:     <system>
Aug 09 19:42:57 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:42:57 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:42:57 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:42:57 user nova-compute[72441]:       <entry name="serial">9f3857fe-1bdc-438d-abff-c07b562e6ede</entry>
Aug 09 19:42:57 user nova-compute[72441]:       <entry name="uuid">9f3857fe-1bdc-438d-abff-c07b562e6ede</entry>
Aug 09 19:42:57 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:42:57 user nova-compute[72441]:     </system>
Aug 09 19:42:57 user nova-compute[72441]:   </sysinfo>
Aug 09 19:42:57 user nova-compute[72441]:   <os>
Aug 09 19:42:57 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:42:57 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:42:57 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:42:57 user nova-compute[72441]:   </os>
Aug 09 19:42:57 user nova-compute[72441]:   <features>
Aug 09 19:42:57 user nova-compute[72441]:     <acpi/>
Aug 09 19:42:57 user nova-compute[72441]:     <apic/>
Aug 09 19:42:57 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:42:57 user nova-compute[72441]:   </features>
Aug 09 19:42:57 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:42:57 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:42:57 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:42:57 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:42:57 user nova-compute[72441]:   </clock>
Aug 09 19:42:57 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:42:57 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:42:57 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:42:57 user nova-compute[72441]:   </cpu>
Aug 09 19:42:57 user nova-compute[72441]:   <devices>
Aug 09 19:42:57 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:42:57 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:42:57 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk"/>
Aug 09 19:42:57 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:42:57 user nova-compute[72441]:     </disk>
Aug 09 19:42:57 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:42:57 user nova-compute[72441]:       <mac address="fa:16:3e:d8:82:8e"/>
Aug 09 19:42:57 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:42:57 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:42:57 user nova-compute[72441]:       <target dev="tap6aecb383-a8"/>
Aug 09 19:42:57 user nova-compute[72441]:     </interface>
Aug 09 19:42:57 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:42:57 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/console.log" append="off"/>
Aug 09 19:42:57 user nova-compute[72441]:     </serial>
Aug 09 19:42:57 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:42:57 user nova-compute[72441]:     <video>
Aug 09 19:42:57 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:42:57 user nova-compute[72441]:     </video>
Aug 09 19:42:57 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:42:57 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:42:57 user nova-compute[72441]:     </rng>
Aug 09 19:42:57 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:42:57 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:42:57 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:42:57 user nova-compute[72441]:     </memballoon>
Aug 09 19:42:57 user nova-compute[72441]:   </devices>
Aug 09 19:42:57 user nova-compute[72441]: </domain>
Aug 09 19:42:57 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:42:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1337116267',display_name='tempest-ServersNegativeTestJSON-server-1337116267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1337116267',id=45,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61244bcc605b44c393b346ad4c7ff324',ramdisk_id='',reservation_id='r-dnunoa0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957430953',owner_user_name='tempest-ServersNegativeTestJSON-957430953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:42:56Z,user_data=None,user_id='523ae2e0c78f4b289d9633deea37011c',uuid=9f3857fe-1bdc-438d-abff-c07b562e6ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converting VIF {"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG os_vif [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aecb383-a8, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6aecb383-a8, col_values=(('external_ids', {'iface-id': '6aecb383-a829-4a33-8310-5e923afb07e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:82:8e', 'vm-uuid': '9f3857fe-1bdc-438d-abff-c07b562e6ede'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:57 user nova-compute[72441]: INFO os_vif [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8')
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] No VIF found with MAC fa:16:3e:d8:82:8e, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'info_cache' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.network.neutron [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Updated VIF entry in instance network info cache for port 6aecb383-a829-4a33-8310-5e923afb07e5. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.network.neutron [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Updating instance_info_cache with network_info: [{"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-13c5c317-b239-4fda-adf8-3e75fbb56efd req-3034a25f-413d-4073-8f82-df16572df9af service nova] Releasing lock "refresh_cache-9f3857fe-1bdc-438d-abff-c07b562e6ede" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.network.neutron [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:42:58 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance destroyed successfully.
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'resources' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG os_vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc484855c-49, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:58 user nova-compute[72441]: INFO os_vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49')
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start _get_guest_xml network_info=[{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:42:58 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'numa_topology' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:42:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'vcpu_model' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'pci_devices' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:42:59 user nova-compute[72441]:   <uuid>c004c872-c398-4e9c-867d-e9d1cddf4735</uuid>
Aug 09 19:42:59 user nova-compute[72441]:   <name>instance-00000028</name>
Aug 09 19:42:59 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:42:59 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:42:59 user nova-compute[72441]:   <metadata>
Aug 09 19:42:59 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:42:59 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:42:59 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1348893918</nova:name>
Aug 09 19:42:59 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:42:59</nova:creationTime>
Aug 09 19:42:59 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:42:59 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:42:59 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:42:59 user nova-compute[72441]:       <nova:owner>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:user uuid="febf31bc22ae4e00a5e7be7c44708626">tempest-AttachVolumeTestJSON-333200942-project-member</nova:user>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:project uuid="bb19329778d94a21828a4d3d61d75217">tempest-AttachVolumeTestJSON-333200942</nova:project>
Aug 09 19:42:59 user nova-compute[72441]:       </nova:owner>
Aug 09 19:42:59 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:42:59 user nova-compute[72441]:       <nova:ports>
Aug 09 19:42:59 user nova-compute[72441]:         <nova:port uuid="c484855c-49b5-4ca8-8e4a-4933ab67a57a">
Aug 09 19:42:59 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 19:42:59 user nova-compute[72441]:         </nova:port>
Aug 09 19:42:59 user nova-compute[72441]:       </nova:ports>
Aug 09 19:42:59 user nova-compute[72441]:     </nova:instance>
Aug 09 19:42:59 user nova-compute[72441]:   </metadata>
Aug 09 19:42:59 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:42:59 user nova-compute[72441]:     <system>
Aug 09 19:42:59 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:42:59 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:42:59 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:42:59 user nova-compute[72441]:       <entry name="serial">c004c872-c398-4e9c-867d-e9d1cddf4735</entry>
Aug 09 19:42:59 user nova-compute[72441]:       <entry name="uuid">c004c872-c398-4e9c-867d-e9d1cddf4735</entry>
Aug 09 19:42:59 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:42:59 user nova-compute[72441]:     </system>
Aug 09 19:42:59 user nova-compute[72441]:   </sysinfo>
Aug 09 19:42:59 user nova-compute[72441]:   <os>
Aug 09 19:42:59 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:42:59 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:42:59 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:42:59 user nova-compute[72441]:   </os>
Aug 09 19:42:59 user nova-compute[72441]:   <features>
Aug 09 19:42:59 user nova-compute[72441]:     <acpi/>
Aug 09 19:42:59 user nova-compute[72441]:     <apic/>
Aug 09 19:42:59 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:42:59 user nova-compute[72441]:   </features>
Aug 09 19:42:59 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:42:59 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:42:59 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:42:59 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:42:59 user nova-compute[72441]:   </clock>
Aug 09 19:42:59 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:42:59 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:42:59 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:42:59 user nova-compute[72441]:   </cpu>
Aug 09 19:42:59 user nova-compute[72441]:   <devices>
Aug 09 19:42:59 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:42:59 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:42:59 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk"/>
Aug 09 19:42:59 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:42:59 user nova-compute[72441]:     </disk>
Aug 09 19:42:59 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:42:59 user nova-compute[72441]:       <mac address="fa:16:3e:9f:69:22"/>
Aug 09 19:42:59 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:42:59 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:42:59 user nova-compute[72441]:       <target dev="tapc484855c-49"/>
Aug 09 19:42:59 user nova-compute[72441]:     </interface>
Aug 09 19:42:59 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:42:59 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/console.log" append="off"/>
Aug 09 19:42:59 user nova-compute[72441]:     </serial>
Aug 09 19:42:59 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:42:59 user nova-compute[72441]:     <video>
Aug 09 19:42:59 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:42:59 user nova-compute[72441]:     </video>
Aug 09 19:42:59 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:42:59 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:42:59 user nova-compute[72441]:     </rng>
Aug 09 19:42:59 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:42:59 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:42:59 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:42:59 user nova-compute[72441]:     </memballoon>
Aug 09 19:42:59 user nova-compute[72441]:   </devices>
Aug 09 19:42:59 user nova-compute[72441]: </domain>
Aug 09 19:42:59 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'trusted_certs' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-4387e749-3246-49b1-9049-b53ef5bd0080 req-f959d29b-6163-4c97-9964-3a5938ac3b5e service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4387e749-3246-49b1-9049-b53ef5bd0080 req-f959d29b-6163-4c97-9964-3a5938ac3b5e service nova] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4387e749-3246-49b1-9049-b53ef5bd0080 req-f959d29b-6163-4c97-9964-3a5938ac3b5e service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4387e749-3246-49b1-9049-b53ef5bd0080 req-f959d29b-6163-4c97-9964-3a5938ac3b5e service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.compute.manager [req-4387e749-3246-49b1-9049-b53ef5bd0080 req-f959d29b-6163-4c97-9964-3a5938ac3b5e service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] No waiting events found dispatching network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:42:59 user nova-compute[72441]: WARNING nova.compute.manager [req-4387e749-3246-49b1-9049-b53ef5bd0080 req-f959d29b-6163-4c97-9964-3a5938ac3b5e service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received unexpected event network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 for instance with vm_state building and task_state spawning.
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Cannot resize image /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'migration_context' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG os_vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc484855c-49, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc484855c-49, col_values=(('external_ids', {'iface-id': 'c484855c-49b5-4ca8-8e4a-4933ab67a57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:69:22', 'vm-uuid': 'c004c872-c398-4e9c-867d-e9d1cddf4735'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:42:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:42:59 user nova-compute[72441]: INFO os_vif [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49')
Aug 09 19:43:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] No waiting events found dispatching network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:43:01 user nova-compute[72441]: WARNING nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received unexpected event network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 for instance with vm_state building and task_state spawning.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:43:01 user nova-compute[72441]: WARNING nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state stopped and task_state powering-on.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:43:01 user nova-compute[72441]: WARNING nova.compute.manager [req-b93f9341-dc7f-4c98-b40e-4de3d6f0c970 req-27fbc549-f8de-423c-8373-028e96c82a98 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state stopped and task_state powering-on.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610181.483673, 9f3857fe-1bdc-438d-abff-c07b562e6ede => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] VM Resumed (Lifecycle Event)
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Instance spawned successfully.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610181.484493, 9f3857fe-1bdc-438d-abff-c07b562e6ede => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] VM Started (Lifecycle Event)
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:01 user nova-compute[72441]: INFO nova.compute.manager [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Took 6.18 seconds to build instance.
Aug 09 19:43:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-8b372566-7f00-4af7-a1f5-824cc4b88fab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.296s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610183.082253, c004c872-c398-4e9c-867d-e9d1cddf4735 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:43:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Resumed (Lifecycle Event)
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:43:03 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance rebooted successfully.
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-c9b99c2c-6101-4ee9-b788-159647ae9d9c tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:43:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610183.0862215, c004c872-c398-4e9c-867d-e9d1cddf4735 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:43:03 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Started (Lifecycle Event)
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:43:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:43:13 user nova-compute[72441]: INFO nova.compute.claims [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Claim successful on node user
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:43:13 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:43:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:43:14 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:43:14 user nova-compute[72441]: INFO nova.virt.block_device [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Booting with volume 1c1d2544-9373-4871-808f-0cb5c141d972 at /dev/vda
Aug 09 19:43:14 user nova-compute[72441]: DEBUG nova.policy [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd066b4d22049d0b2129ad1f38ef9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ae81254564eadaf8042330cb1fdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG os_brick.utils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5476bb56-69fd-4389-b662-0695fb8e994c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[948019d9-6d49-4af4-bacc-4990a54c55a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d1f1d-d241-46f1-947a-70d4fdc3228f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91454251-3e76-498f-bfea-27333e31f7af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:43:14 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:43:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b75c4-b368-4855-8bcf-2fb64adb3633]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG os_brick.utils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating existing volume attachment record: 664f00c0-5187-43c3-a0d8-758ab7ab63b5 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:43:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Successfully created port: 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Successfully updated port: 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquired lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-changed-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Refreshing instance network info cache due to event network-changed-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:43:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] Acquiring lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating instance_info_cache with network_info: [{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Releasing lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Instance network_info: |[{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] Acquired lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Refreshing network info cache for port 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updated VIF entry in instance network info cache for port 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG nova.network.neutron [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating instance_info_cache with network_info: [{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-35554ade-9670-430d-9763-f48722ed18e1 req-99ea89d0-3d0c-4562-9b9f-bf07dc7fbfce service nova] Releasing lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:43:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:43:22 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Creating image(s)
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Ensure instance console log exists: /opt/stack/data/nova/instances/d3117f89-ee7f-46d9-9cb8-3690a4e2748d/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Start _get_guest_xml network_info=[{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3117f89-ee7f-46d9-9cb8-3690a4e2748d', 'attached_at': '', 'detached_at': '', 'volume_id': '1c1d2544-9373-4871-808f-0cb5c141d972', 'serial': '1c1d2544-9373-4871-808f-0cb5c141d972'}, 'attachment_id': '664f00c0-5187-43c3-a0d8-758ab7ab63b5', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:43:22 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:43:22 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:43:22 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:43:22 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:43:22 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc84bf0-b9e3-4e5b-be7e-8d8a2fd26526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:43:22 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eda690-7dd5-4e30-9826-ee1b9a0f5f9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972] added
Aug 09 19:43:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba004d5e-d800-4dd5-bfa7-9cca6fe825d6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9144772-ac86-45ea-9927-cfa62eb944bd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqJCUlkS {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqJCUlkS" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788c6c4-6c63-4f95-aac2-d1c8bafedb61]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqJCUlkS'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c94517-f518-430c-aa4f-3c23a2ce7c7a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbc93a7-c991-4704-b2de-555ab9616d3c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:43:22 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:43:22 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:43:22 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:43:22 user nova-compute[72441]: 
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[793839de-53e7-4d1f-93d5-30ba887a2a72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]
Aug 09 19:43:22 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.
Aug 09 19:43:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ec7d3-f0a7-45fe-b76d-09a57aa632f8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1844b067-4afc-4184-af64-1f8f13335161]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:43:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:43:22 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:22 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:23 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[763253b2-cd9e-44cd-a5db-313c72ff6f1a]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:43:23 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:43:23 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23231346133373634', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231346133373634', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1304580252',display_name='tempest-TestVolumeBootPattern-server-1304580252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1304580252',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-3ff9lit0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:43:14Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=d3117f89-ee7f-46d9-9cb8-3690a4e2748d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'pci_devices' on Instance uuid d3117f89-ee7f-46d9-9cb8-3690a4e2748d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:43:24 user nova-compute[72441]:   <uuid>d3117f89-ee7f-46d9-9cb8-3690a4e2748d</uuid>
Aug 09 19:43:24 user nova-compute[72441]:   <name>instance-0000002e</name>
Aug 09 19:43:24 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:43:24 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:43:24 user nova-compute[72441]:   <metadata>
Aug 09 19:43:24 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:43:24 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:43:24 user nova-compute[72441]:       <nova:name>tempest-TestVolumeBootPattern-server-1304580252</nova:name>
Aug 09 19:43:24 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:43:22</nova:creationTime>
Aug 09 19:43:24 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:43:24 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:43:24 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:43:24 user nova-compute[72441]:       <nova:owner>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:user uuid="0fd066b4d22049d0b2129ad1f38ef9e4">tempest-TestVolumeBootPattern-1486219267-project-member</nova:user>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:project uuid="256ae81254564eadaf8042330cb1fdce">tempest-TestVolumeBootPattern-1486219267</nova:project>
Aug 09 19:43:24 user nova-compute[72441]:       </nova:owner>
Aug 09 19:43:24 user nova-compute[72441]:       <nova:ports>
Aug 09 19:43:24 user nova-compute[72441]:         <nova:port uuid="65a853a0-afe5-42e8-ae41-2e5dbb79a2c4">
Aug 09 19:43:24 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 19:43:24 user nova-compute[72441]:         </nova:port>
Aug 09 19:43:24 user nova-compute[72441]:       </nova:ports>
Aug 09 19:43:24 user nova-compute[72441]:     </nova:instance>
Aug 09 19:43:24 user nova-compute[72441]:   </metadata>
Aug 09 19:43:24 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:43:24 user nova-compute[72441]:     <system>
Aug 09 19:43:24 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:43:24 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:43:24 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:43:24 user nova-compute[72441]:       <entry name="serial">d3117f89-ee7f-46d9-9cb8-3690a4e2748d</entry>
Aug 09 19:43:24 user nova-compute[72441]:       <entry name="uuid">d3117f89-ee7f-46d9-9cb8-3690a4e2748d</entry>
Aug 09 19:43:24 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:43:24 user nova-compute[72441]:     </system>
Aug 09 19:43:24 user nova-compute[72441]:   </sysinfo>
Aug 09 19:43:24 user nova-compute[72441]:   <os>
Aug 09 19:43:24 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:43:24 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:43:24 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:43:24 user nova-compute[72441]:   </os>
Aug 09 19:43:24 user nova-compute[72441]:   <features>
Aug 09 19:43:24 user nova-compute[72441]:     <acpi/>
Aug 09 19:43:24 user nova-compute[72441]:     <apic/>
Aug 09 19:43:24 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:43:24 user nova-compute[72441]:   </features>
Aug 09 19:43:24 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:43:24 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:43:24 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:43:24 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:43:24 user nova-compute[72441]:   </clock>
Aug 09 19:43:24 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:43:24 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:43:24 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:43:24 user nova-compute[72441]:   </cpu>
Aug 09 19:43:24 user nova-compute[72441]:   <devices>
Aug 09 19:43:24 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:43:24 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:43:24 user nova-compute[72441]:       <source dev="/dev/sdb"/>
Aug 09 19:43:24 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:43:24 user nova-compute[72441]:       <serial>1c1d2544-9373-4871-808f-0cb5c141d972</serial>
Aug 09 19:43:24 user nova-compute[72441]:     </disk>
Aug 09 19:43:24 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:43:24 user nova-compute[72441]:       <mac address="fa:16:3e:2e:a4:a1"/>
Aug 09 19:43:24 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:43:24 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:43:24 user nova-compute[72441]:       <target dev="tap65a853a0-af"/>
Aug 09 19:43:24 user nova-compute[72441]:     </interface>
Aug 09 19:43:24 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:43:24 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/d3117f89-ee7f-46d9-9cb8-3690a4e2748d/console.log" append="off"/>
Aug 09 19:43:24 user nova-compute[72441]:     </serial>
Aug 09 19:43:24 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:43:24 user nova-compute[72441]:     <video>
Aug 09 19:43:24 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:43:24 user nova-compute[72441]:     </video>
Aug 09 19:43:24 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:43:24 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:43:24 user nova-compute[72441]:     </rng>
Aug 09 19:43:24 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:43:24 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:43:24 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:43:24 user nova-compute[72441]:     </memballoon>
Aug 09 19:43:24 user nova-compute[72441]:   </devices>
Aug 09 19:43:24 user nova-compute[72441]: </domain>
Aug 09 19:43:24 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1304580252',display_name='tempest-TestVolumeBootPattern-server-1304580252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1304580252',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-3ff9lit0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:43:14Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=d3117f89-ee7f-46d9-9cb8-3690a4e2748d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG os_vif [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65a853a0-af, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65a853a0-af, col_values=(('external_ids', {'iface-id': '65a853a0-afe5-42e8-ae41-2e5dbb79a2c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:a4:a1', 'vm-uuid': 'd3117f89-ee7f-46d9-9cb8-3690a4e2748d'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:24 user nova-compute[72441]: INFO os_vif [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af')
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:43:24 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No VIF found with MAC fa:16:3e:2e:a4:a1, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-98cc2181-bf58-4bb8-b576-ec89eb650b19 req-b82235e1-ca6b-42ac-8b10-918f221cea09 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-98cc2181-bf58-4bb8-b576-ec89eb650b19 req-b82235e1-ca6b-42ac-8b10-918f221cea09 service nova] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-98cc2181-bf58-4bb8-b576-ec89eb650b19 req-b82235e1-ca6b-42ac-8b10-918f221cea09 service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-98cc2181-bf58-4bb8-b576-ec89eb650b19 req-b82235e1-ca6b-42ac-8b10-918f221cea09 service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG nova.compute.manager [req-98cc2181-bf58-4bb8-b576-ec89eb650b19 req-b82235e1-ca6b-42ac-8b10-918f221cea09 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] No waiting events found dispatching network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:43:25 user nova-compute[72441]: WARNING nova.compute.manager [req-98cc2181-bf58-4bb8-b576-ec89eb650b19 req-b82235e1-ca6b-42ac-8b10-918f221cea09 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received unexpected event network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 for instance with vm_state building and task_state spawning.
Aug 09 19:43:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610207.4701495, d3117f89-ee7f-46d9-9cb8-3690a4e2748d => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] VM Resumed (Lifecycle Event)
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Instance spawned successfully.
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610207.4718168, d3117f89-ee7f-46d9-9cb8-3690a4e2748d => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] VM Started (Lifecycle Event)
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:43:27 user nova-compute[72441]: INFO nova.compute.manager [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Took 14.12 seconds to build instance.
Aug 09 19:43:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9fc89968-3a22-49c4-999d-43ed98f63364 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.239s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba570633-f64a-45bc-9386-8aff44910e9d req-aa1e13e0-734b-4c7a-b6de-0fad259f3098 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba570633-f64a-45bc-9386-8aff44910e9d req-aa1e13e0-734b-4c7a-b6de-0fad259f3098 service nova] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba570633-f64a-45bc-9386-8aff44910e9d req-aa1e13e0-734b-4c7a-b6de-0fad259f3098 service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ba570633-f64a-45bc-9386-8aff44910e9d req-aa1e13e0-734b-4c7a-b6de-0fad259f3098 service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:27 user nova-compute[72441]: DEBUG nova.compute.manager [req-ba570633-f64a-45bc-9386-8aff44910e9d req-aa1e13e0-734b-4c7a-b6de-0fad259f3098 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] No waiting events found dispatching network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:43:27 user nova-compute[72441]: WARNING nova.compute.manager [req-ba570633-f64a-45bc-9386-8aff44910e9d req-aa1e13e0-734b-4c7a-b6de-0fad259f3098 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received unexpected event network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 for instance with vm_state active and task_state None.
Aug 09 19:43:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:40 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:43:40 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:43:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:43:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:43:45 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:43:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:43:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8209MB free_disk=25.150604248046875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:43:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 9f3857fe-1bdc-438d-abff-c07b562e6ede actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d3117f89-ee7f-46d9-9cb8-3690a4e2748d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:43:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:43:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:43:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:44:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:44:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:44:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:44:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:44:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:44:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:15 user nova-compute[72441]: INFO nova.compute.manager [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Unshelving
Aug 09 19:44:15 user nova-compute[72441]: INFO nova.virt.block_device [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Booting with volume 547c3d8c-2856-4034-9fd0-766d6d9db408 at /dev/vda
Aug 09 19:44:15 user nova-compute[72441]: DEBUG os_brick.utils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[307576db-580b-436d-93f4-b2a9af2cbe52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dee8df0-e342-48ed-9a7a-a30a7408a628]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879cc47-6390-4756-9ecc-254e6bf5ab29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d42d59-ad72-4604-9a89-7809226843cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:44:15 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:44:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f5b51c-6b46-48f1-baa5-ec677572585f]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG os_brick.utils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:44:15 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating existing volume attachment record: daed2fc2-08f6-476a-b081-7686057c535c {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:44:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:44:23 user nova-compute[72441]: INFO nova.compute.claims [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Claim successful on node user
Aug 09 19:44:23 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:44:23 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:24 user nova-compute[72441]: INFO nova.network.neutron [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating port 7f1f2da4-8966-4874-8261-8324c96e8257 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG nova.compute.manager [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing instance network info cache due to event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:44:24 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.network.neutron [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:44:25 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Creating image(s)
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Ensure instance console log exists: /opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Start _get_guest_xml network_info=[{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b0b69c2-28a7-444f-84ab-f47d63235dbc', 'attached_at': '', 'detached_at': '', 'volume_id': '547c3d8c-2856-4034-9fd0-766d6d9db408', 'serial': '547c3d8c-2856-4034-9fd0-766d6d9db408'}, 'attachment_id': 'daed2fc2-08f6-476a-b081-7686057c535c', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:44:25 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:44:25 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:44:25 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:44:25 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:44:25 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf3876c-f093-4d7a-bdbd-f9f7ad0193bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:44:25 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2679bccd-e19c-4286-8045-8a60dadc693c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408] added
Aug 09 19:44:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac6d12d-4806-4575-aa60-ae7a33003aec]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950fc61-ce6a-4751-a64a-b19c25bc5e6c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHiwSXLl {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHiwSXLl" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ace759-593e-4b27-a500-efc153274d52]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHiwSXLl'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c2f774-890e-4200-b6a7-e0e0e0b6d9f6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b1324-ded3-4c56-a9fe-866d6559a1d7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:44:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:44:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b2cff-b828-48e6-ba4e-d977d59e11f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]
Aug 09 19:44:25 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.
Aug 09 19:44:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a0ee85-ab1b-43ff-97c6-370acdb057e8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18e7432-c856-4179-90c6-23346b7454c5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:44:25 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:44:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:44:25 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:44:25 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec5e2b-c692-4a8a-a96f-882298ba8d95]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updated VIF entry in instance network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG nova.network.neutron [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:44:25 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0045b277-2342-4794-8fa6-7e58e65ea182 req-91e50d00-48c6-462f-af41-0caaaf5aed2e service nova] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26464636665393336', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464636665393336', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-414112240',display_name='tempest-TestShelveInstance-server-414112240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-414112240',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-595052958',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ff19d044abd840ab98dac7fe1e20ddc3',ramdisk_id='',reservation_id='r-ynxt8uc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1365792064',owner_user_name='tempest-TestShelveInstance-1365792064-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:44:15Z,user_data=None,user_id='cb23b737f92a4b638b43ea8a1d195a5e',uuid=5b0b69c2-28a7-444f-84ab-f47d63235dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converting VIF {"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:44:26 user nova-compute[72441]:   <uuid>5b0b69c2-28a7-444f-84ab-f47d63235dbc</uuid>
Aug 09 19:44:26 user nova-compute[72441]:   <name>instance-0000002b</name>
Aug 09 19:44:26 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:44:26 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:44:26 user nova-compute[72441]:   <metadata>
Aug 09 19:44:26 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:44:26 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:44:26 user nova-compute[72441]:       <nova:name>tempest-TestShelveInstance-server-414112240</nova:name>
Aug 09 19:44:26 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:44:25</nova:creationTime>
Aug 09 19:44:26 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:44:26 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:44:26 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:44:26 user nova-compute[72441]:       <nova:owner>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:user uuid="cb23b737f92a4b638b43ea8a1d195a5e">tempest-TestShelveInstance-1365792064-project-member</nova:user>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:project uuid="ff19d044abd840ab98dac7fe1e20ddc3">tempest-TestShelveInstance-1365792064</nova:project>
Aug 09 19:44:26 user nova-compute[72441]:       </nova:owner>
Aug 09 19:44:26 user nova-compute[72441]:       <nova:ports>
Aug 09 19:44:26 user nova-compute[72441]:         <nova:port uuid="7f1f2da4-8966-4874-8261-8324c96e8257">
Aug 09 19:44:26 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 19:44:26 user nova-compute[72441]:         </nova:port>
Aug 09 19:44:26 user nova-compute[72441]:       </nova:ports>
Aug 09 19:44:26 user nova-compute[72441]:     </nova:instance>
Aug 09 19:44:26 user nova-compute[72441]:   </metadata>
Aug 09 19:44:26 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:44:26 user nova-compute[72441]:     <system>
Aug 09 19:44:26 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:44:26 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:44:26 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:44:26 user nova-compute[72441]:       <entry name="serial">5b0b69c2-28a7-444f-84ab-f47d63235dbc</entry>
Aug 09 19:44:26 user nova-compute[72441]:       <entry name="uuid">5b0b69c2-28a7-444f-84ab-f47d63235dbc</entry>
Aug 09 19:44:26 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:44:26 user nova-compute[72441]:     </system>
Aug 09 19:44:26 user nova-compute[72441]:   </sysinfo>
Aug 09 19:44:26 user nova-compute[72441]:   <os>
Aug 09 19:44:26 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:44:26 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:44:26 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:44:26 user nova-compute[72441]:   </os>
Aug 09 19:44:26 user nova-compute[72441]:   <features>
Aug 09 19:44:26 user nova-compute[72441]:     <acpi/>
Aug 09 19:44:26 user nova-compute[72441]:     <apic/>
Aug 09 19:44:26 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:44:26 user nova-compute[72441]:   </features>
Aug 09 19:44:26 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:44:26 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:44:26 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:44:26 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:44:26 user nova-compute[72441]:   </clock>
Aug 09 19:44:26 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:44:26 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:44:26 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:44:26 user nova-compute[72441]:   </cpu>
Aug 09 19:44:26 user nova-compute[72441]:   <devices>
Aug 09 19:44:26 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:44:26 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:44:26 user nova-compute[72441]:       <source dev="/dev/sdc"/>
Aug 09 19:44:26 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:44:26 user nova-compute[72441]:       <serial>547c3d8c-2856-4034-9fd0-766d6d9db408</serial>
Aug 09 19:44:26 user nova-compute[72441]:     </disk>
Aug 09 19:44:26 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:44:26 user nova-compute[72441]:       <mac address="fa:16:3e:d1:de:98"/>
Aug 09 19:44:26 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:44:26 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:44:26 user nova-compute[72441]:       <target dev="tap7f1f2da4-89"/>
Aug 09 19:44:26 user nova-compute[72441]:     </interface>
Aug 09 19:44:26 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:44:26 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc/console.log" append="off"/>
Aug 09 19:44:26 user nova-compute[72441]:     </serial>
Aug 09 19:44:26 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:44:26 user nova-compute[72441]:     <video>
Aug 09 19:44:26 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:44:26 user nova-compute[72441]:     </video>
Aug 09 19:44:26 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:44:26 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:44:26 user nova-compute[72441]:     </rng>
Aug 09 19:44:26 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:44:26 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:44:26 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:44:26 user nova-compute[72441]:     </memballoon>
Aug 09 19:44:26 user nova-compute[72441]:   </devices>
Aug 09 19:44:26 user nova-compute[72441]: </domain>
Aug 09 19:44:26 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-414112240',display_name='tempest-TestShelveInstance-server-414112240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-414112240',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-595052958',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ff19d044abd840ab98dac7fe1e20ddc3',ramdisk_id='',reservation_id='r-ynxt8uc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1365792064',owner_user_name='tempest-TestShelveInstance-1365792064-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:44:15Z,user_data=None,user_id='cb23b737f92a4b638b43ea8a1d195a5e',uuid=5b0b69c2-28a7-444f-84ab-f47d63235dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converting VIF {"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG os_vif [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f1f2da4-89, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f1f2da4-89, col_values=(('external_ids', {'iface-id': '7f1f2da4-8966-4874-8261-8324c96e8257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:de:98', 'vm-uuid': '5b0b69c2-28a7-444f-84ab-f47d63235dbc'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:26 user nova-compute[72441]: INFO os_vif [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89')
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:44:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] No VIF found with MAC fa:16:3e:d1:de:98, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:44:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-98825091-ea09-467e-baa5-9f0a06eaa44d req-bc3a7805-919e-41ed-a84a-0939c0de6704 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-98825091-ea09-467e-baa5-9f0a06eaa44d req-bc3a7805-919e-41ed-a84a-0939c0de6704 service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-98825091-ea09-467e-baa5-9f0a06eaa44d req-bc3a7805-919e-41ed-a84a-0939c0de6704 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-98825091-ea09-467e-baa5-9f0a06eaa44d req-bc3a7805-919e-41ed-a84a-0939c0de6704 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-98825091-ea09-467e-baa5-9f0a06eaa44d req-bc3a7805-919e-41ed-a84a-0939c0de6704 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:44:28 user nova-compute[72441]: WARNING nova.compute.manager [req-98825091-ea09-467e-baa5-9f0a06eaa44d req-bc3a7805-919e-41ed-a84a-0939c0de6704 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 19:44:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610270.1300905, 5b0b69c2-28a7-444f-84ab-f47d63235dbc => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:44:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] VM Resumed (Lifecycle Event)
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:44:30 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance spawned successfully.
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:44:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610270.1315417, 5b0b69c2-28a7-444f-84ab-f47d63235dbc => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:44:30 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] VM Started (Lifecycle Event)
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-3118083f-0a03-454b-9580-80274ffff763 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.163s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-d91894e8-c281-40ad-8aad-85c8f62c4854 req-a91313f5-b11e-4972-8854-3db9a42c0080 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d91894e8-c281-40ad-8aad-85c8f62c4854 req-a91313f5-b11e-4972-8854-3db9a42c0080 service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d91894e8-c281-40ad-8aad-85c8f62c4854 req-a91313f5-b11e-4972-8854-3db9a42c0080 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d91894e8-c281-40ad-8aad-85c8f62c4854 req-a91313f5-b11e-4972-8854-3db9a42c0080 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:30 user nova-compute[72441]: DEBUG nova.compute.manager [req-d91894e8-c281-40ad-8aad-85c8f62c4854 req-a91313f5-b11e-4972-8854-3db9a42c0080 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:44:30 user nova-compute[72441]: WARNING nova.compute.manager [req-d91894e8-c281-40ad-8aad-85c8f62c4854 req-a91313f5-b11e-4972-8854-3db9a42c0080 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state active and task_state None.
Aug 09 19:44:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 6b04a9f9-5403-443c-99f5-122bb3d2d117 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 9f3857fe-1bdc-438d-abff-c07b562e6ede {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid d3117f89-ee7f-46d9-9cb8-3690a4e2748d {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:44:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:44:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [{"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-c004c872-c398-4e9c-867d-e9d1cddf4735" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:45 user nova-compute[72441]: INFO nova.compute.manager [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Terminating instance
Aug 09 19:44:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-caa49d47-ea68-43cc-982d-22f9d2cd658d req-9569b682-a48c-41a9-b352-b06586be0b01 service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-vif-unplugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-caa49d47-ea68-43cc-982d-22f9d2cd658d req-9569b682-a48c-41a9-b352-b06586be0b01 service nova] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-caa49d47-ea68-43cc-982d-22f9d2cd658d req-9569b682-a48c-41a9-b352-b06586be0b01 service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-caa49d47-ea68-43cc-982d-22f9d2cd658d req-9569b682-a48c-41a9-b352-b06586be0b01 service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-caa49d47-ea68-43cc-982d-22f9d2cd658d req-9569b682-a48c-41a9-b352-b06586be0b01 service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] No waiting events found dispatching network-vif-unplugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-caa49d47-ea68-43cc-982d-22f9d2cd658d req-9569b682-a48c-41a9-b352-b06586be0b01 service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-vif-unplugged-6aecb383-a829-4a33-8310-5e923afb07e5 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Instance destroyed successfully.
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lazy-loading 'resources' on Instance uuid 9f3857fe-1bdc-438d-abff-c07b562e6ede {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:42:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1337116267',display_name='tempest-ServersNegativeTestJSON-server-1337116267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1337116267',id=45,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61244bcc605b44c393b346ad4c7ff324',ramdisk_id='',reservation_id='r-dnunoa0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-957430953',owner_user_name='tempest-ServersNegativeTestJSON-957430953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:43:02Z,user_data=None,user_id='523ae2e0c78f4b289d9633deea37011c',uuid=9f3857fe-1bdc-438d-abff-c07b562e6ede,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converting VIF {"id": "6aecb383-a829-4a33-8310-5e923afb07e5", "address": "fa:16:3e:d8:82:8e", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aecb383-a8", "ovs_interfaceid": "6aecb383-a829-4a33-8310-5e923afb07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG os_vif [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aecb383-a8, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:46 user nova-compute[72441]: INFO os_vif [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:82:8e,bridge_name='br-int',has_traffic_filtering=True,id=6aecb383-a829-4a33-8310-5e923afb07e5,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aecb383-a8')
Aug 09 19:44:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Deleting instance files /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede_del
Aug 09 19:44:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Deletion of /opt/stack/data/nova/instances/9f3857fe-1bdc-438d-abff-c07b562e6ede_del complete
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:44:46 user nova-compute[72441]: INFO nova.compute.manager [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:46 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:44:47 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Took 0.48 seconds to deallocate network for instance.
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:47 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:44:47 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8193MB free_disk=25.166767120361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:47 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Deleted allocations for instance 9f3857fe-1bdc-438d-abff-c07b562e6ede
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance c004c872-c398-4e9c-867d-e9d1cddf4735 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d3117f89-ee7f-46d9-9cb8-3690a4e2748d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 5b0b69c2-28a7-444f-84ab-f47d63235dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d2d2911a-b670-413d-8e83-281cd060c8ab tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:44:47 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] Acquiring lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] Lock "9f3857fe-1bdc-438d-abff-c07b562e6ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] No waiting events found dispatching network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:44:48 user nova-compute[72441]: WARNING nova.compute.manager [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received unexpected event network-vif-plugged-6aecb383-a829-4a33-8310-5e923afb07e5 for instance with vm_state deleted and task_state None.
Aug 09 19:44:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-99af1825-7b81-4aa9-b851-7269398df1c2 req-1c84ccf6-8280-48f7-b71f-11e5cbfa6f4d service nova] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Received event network-vif-deleted-6aecb383-a829-4a33-8310-5e923afb07e5 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:49 user nova-compute[72441]: INFO nova.compute.manager [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Terminating instance
Aug 09 19:44:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:50 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Instance destroyed successfully.
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'resources' on Instance uuid c004c872-c398-4e9c-867d-e9d1cddf4735 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348893918',display_name='tempest-AttachVolumeTestJSON-server-1348893918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348893918',id=40,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjEwzz2SOk663/2IFjn33uFCI9EElAXN+8/22OFDKwMb0jlL2OmKC7PfL8BbozgvBqQ1/ET2U37IvZLeVNYJAr61IbMof0yr+GpAnSnFgpCjClsnDVLM9KSV6wllB3sA==',key_name='tempest-keypair-2121791005',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-yhp4gxau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=c004c872-c398-4e9c-867d-e9d1cddf4735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "address": "fa:16:3e:9f:69:22", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc484855c-49", "ovs_interfaceid": "c484855c-49b5-4ca8-8e4a-4933ab67a57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG os_vif [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc484855c-49, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:44:50 user nova-compute[72441]: INFO os_vif [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:69:22,bridge_name='br-int',has_traffic_filtering=True,id=c484855c-49b5-4ca8-8e4a-4933ab67a57a,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc484855c-49')
Aug 09 19:44:50 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Deleting instance files /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735_del
Aug 09 19:44:50 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Deletion of /opt/stack/data/nova/instances/c004c872-c398-4e9c-867d-e9d1cddf4735_del complete
Aug 09 19:44:50 user nova-compute[72441]: INFO nova.compute.manager [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-unplugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] Acquiring lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] No waiting events found dispatching network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:44:50 user nova-compute[72441]: WARNING nova.compute.manager [req-a22d6848-6f00-4f75-a43f-240b9fa8c567 req-e97c1089-21e6-41a0-ac72-30e55dee3062 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received unexpected event network-vif-plugged-c484855c-49b5-4ca8-8e4a-4933ab67a57a for instance with vm_state active and task_state deleting.
Aug 09 19:44:51 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:44:51 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Took 0.96 seconds to deallocate network for instance.
Aug 09 19:44:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:44:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:44:51 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:44:51 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:44:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:51 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Deleted allocations for instance c004c872-c398-4e9c-867d-e9d1cddf4735
Aug 09 19:44:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-316a192a-b267-433c-b672-9e8b96d5da42 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "c004c872-c398-4e9c-867d-e9d1cddf4735" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:44:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-edad4b53-6c5f-4e40-bf37-03bd92f25890 req-c49791a7-7336-45d0-aab0-a74457381690 service nova] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Received event network-vif-deleted-c484855c-49b5-4ca8-8e4a-4933ab67a57a {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:44:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:44:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:01 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610286.4248903, 9f3857fe-1bdc-438d-abff-c07b562e6ede => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:45:01 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] VM Stopped (Lifecycle Event)
Aug 09 19:45:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-2e3b743d-baee-4175-a51b-46cc1c8bf99f None None] [instance: 9f3857fe-1bdc-438d-abff-c07b562e6ede] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610290.0297074, c004c872-c398-4e9c-867d-e9d1cddf4735 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:45:05 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] VM Stopped (Lifecycle Event)
Aug 09 19:45:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-08bbba58-702c-43a4-a8cd-473edd84edd3 None None] [instance: c004c872-c398-4e9c-867d-e9d1cddf4735] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-changed-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Refreshing instance network info cache due to event network-changed-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] Acquiring lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] Acquired lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:45:05 user nova-compute[72441]: DEBUG nova.network.neutron [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Refreshing network info cache for port 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:45:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updated VIF entry in instance network info cache for port 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:45:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating instance_info_cache with network_info: [{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:45:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-c3cf961c-9251-497f-a882-420e8bd9483d req-bea8892a-5c0c-4c46-ae7b-19d23df8aac0 service nova] Releasing lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:45:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:17 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:45:18 user nova-compute[72441]: INFO nova.compute.claims [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Claim successful on node user
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:45:18 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:45:18 user nova-compute[72441]: INFO nova.virt.block_device [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Booting with volume 050d9b4c-3b51-4771-b281-9c6607c4be2b at /dev/vda
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.policy [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd066b4d22049d0b2129ad1f38ef9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ae81254564eadaf8042330cb1fdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG os_brick.utils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[235cc311-435b-438d-98c9-827065b343a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63acc646-673e-47ed-aa6c-39436021d848]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdea513-7dd2-4e30-babd-b90a1262d9b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76cc3b0-0659-406d-8eba-3b1fce0c073a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:45:18 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:45:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe643d9-21e8-4073-8771-3599947a5cb0]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG os_brick.utils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:45:18 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating existing volume attachment record: 6c929cff-8d5c-44ad-bf60-52007f74815c {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:45:19 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Successfully created port: d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:45:19 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Successfully updated port: d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:45:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:45:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquired lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:45:19 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:45:19 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-changed-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Refreshing instance network info cache due to event network-changed-d38f894c-655b-4833-82a0-a54e69e738f7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] Acquiring lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.network.neutron [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating instance_info_cache with network_info: [{"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Releasing lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Instance network_info: |[{"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] Acquired lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.network.neutron [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Refreshing network info cache for port d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.network.neutron [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updated VIF entry in instance network info cache for port d38f894c-655b-4833-82a0-a54e69e738f7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG nova.network.neutron [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating instance_info_cache with network_info: [{"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:45:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52203573-cc36-47f5-b227-9d2a0f3967cb req-d4cbfb12-2360-4dcc-bd1d-b743894001c4 service nova] Releasing lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:45:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:45:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Creating image(s)
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Did not create local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Ensure instance console log exists: /opt/stack/data/nova/instances/3f6b2156-4e79-4ce7-b489-1f936c87769a/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Start _get_guest_xml network_info=[{"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXhlfwOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f6b2156-4e79-4ce7-b489-1f936c87769a', 'attached_at': '', 'detached_at': '', 'volume_id': '050d9b4c-3b51-4771-b281-9c6607c4be2b', 'serial': '050d9b4c-3b51-4771-b281-9c6607c4be2b'}, 'attachment_id': '6c929cff-8d5c-44ad-bf60-52007f74815c', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:45:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:45:26 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:45:26 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXhlfwOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:45:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:45:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:45:27 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef62840-5c71-4131-b002-e09bb310f98c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:45:27 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b2570-340b-49e8-9b3b-6df5af84d380]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b] added
Aug 09 19:45:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aaba64-fda5-476b-9d07-60fe244276df]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[02555bc2-255d-4b5a-b66a-a18150f0825d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXhlfwOF {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXhlfwOF" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b750bf-e8af-464d-8266-105a27bdd63c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXhlfwOF'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae1269-21b6-435a-9568-cd68fd29d7ab]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7d0867-95bc-4eec-a12d-361e2e5c4966]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c60db-fa6b-4608-b293-cfb35f2eb9d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260]
Aug 09 19:45:27 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260] successful.
Aug 09 19:45:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a137e21-2986-4446-87a4-07f66a9ba9c8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb0147-b484-4e9a-bd58-4525c6177f08]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)
Aug 09 19:45:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:45:27 user nova-compute[72441]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)
Aug 09 19:45:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c74563-f3d4-41b2-b69a-72f9400c9caf]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:45:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXhlfwOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26138623630306432', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138623630306432', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1657982581',display_name='tempest-TestVolumeBootPattern-server-1657982581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1657982581',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-5vxgmnfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:45:19Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=3f6b2156-4e79-4ce7-b489-1f936c87769a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f6b2156-4e79-4ce7-b489-1f936c87769a {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:45:28 user nova-compute[72441]:   <uuid>3f6b2156-4e79-4ce7-b489-1f936c87769a</uuid>
Aug 09 19:45:28 user nova-compute[72441]:   <name>instance-0000002f</name>
Aug 09 19:45:28 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:45:28 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:45:28 user nova-compute[72441]:   <metadata>
Aug 09 19:45:28 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:45:28 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:45:28 user nova-compute[72441]:       <nova:name>tempest-TestVolumeBootPattern-server-1657982581</nova:name>
Aug 09 19:45:28 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:45:26</nova:creationTime>
Aug 09 19:45:28 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:45:28 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:45:28 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:45:28 user nova-compute[72441]:       <nova:owner>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:user uuid="0fd066b4d22049d0b2129ad1f38ef9e4">tempest-TestVolumeBootPattern-1486219267-project-member</nova:user>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:project uuid="256ae81254564eadaf8042330cb1fdce">tempest-TestVolumeBootPattern-1486219267</nova:project>
Aug 09 19:45:28 user nova-compute[72441]:       </nova:owner>
Aug 09 19:45:28 user nova-compute[72441]:       <nova:ports>
Aug 09 19:45:28 user nova-compute[72441]:         <nova:port uuid="d38f894c-655b-4833-82a0-a54e69e738f7">
Aug 09 19:45:28 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 19:45:28 user nova-compute[72441]:         </nova:port>
Aug 09 19:45:28 user nova-compute[72441]:       </nova:ports>
Aug 09 19:45:28 user nova-compute[72441]:     </nova:instance>
Aug 09 19:45:28 user nova-compute[72441]:   </metadata>
Aug 09 19:45:28 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:45:28 user nova-compute[72441]:     <system>
Aug 09 19:45:28 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:45:28 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:45:28 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:45:28 user nova-compute[72441]:       <entry name="serial">3f6b2156-4e79-4ce7-b489-1f936c87769a</entry>
Aug 09 19:45:28 user nova-compute[72441]:       <entry name="uuid">3f6b2156-4e79-4ce7-b489-1f936c87769a</entry>
Aug 09 19:45:28 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:45:28 user nova-compute[72441]:     </system>
Aug 09 19:45:28 user nova-compute[72441]:   </sysinfo>
Aug 09 19:45:28 user nova-compute[72441]:   <os>
Aug 09 19:45:28 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:45:28 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:45:28 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:45:28 user nova-compute[72441]:   </os>
Aug 09 19:45:28 user nova-compute[72441]:   <features>
Aug 09 19:45:28 user nova-compute[72441]:     <acpi/>
Aug 09 19:45:28 user nova-compute[72441]:     <apic/>
Aug 09 19:45:28 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:45:28 user nova-compute[72441]:   </features>
Aug 09 19:45:28 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:45:28 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:45:28 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:45:28 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:45:28 user nova-compute[72441]:   </clock>
Aug 09 19:45:28 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:45:28 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:45:28 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:45:28 user nova-compute[72441]:   </cpu>
Aug 09 19:45:28 user nova-compute[72441]:   <devices>
Aug 09 19:45:28 user nova-compute[72441]:     <disk type="block" device="disk">
Aug 09 19:45:28 user nova-compute[72441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:45:28 user nova-compute[72441]:       <source dev="/dev/sdd"/>
Aug 09 19:45:28 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:45:28 user nova-compute[72441]:       <serial>050d9b4c-3b51-4771-b281-9c6607c4be2b</serial>
Aug 09 19:45:28 user nova-compute[72441]:     </disk>
Aug 09 19:45:28 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:45:28 user nova-compute[72441]:       <mac address="fa:16:3e:9e:a1:25"/>
Aug 09 19:45:28 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:45:28 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:45:28 user nova-compute[72441]:       <target dev="tapd38f894c-65"/>
Aug 09 19:45:28 user nova-compute[72441]:     </interface>
Aug 09 19:45:28 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:45:28 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/3f6b2156-4e79-4ce7-b489-1f936c87769a/console.log" append="off"/>
Aug 09 19:45:28 user nova-compute[72441]:     </serial>
Aug 09 19:45:28 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:45:28 user nova-compute[72441]:     <video>
Aug 09 19:45:28 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:45:28 user nova-compute[72441]:     </video>
Aug 09 19:45:28 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:45:28 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:45:28 user nova-compute[72441]:     </rng>
Aug 09 19:45:28 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:45:28 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:45:28 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:45:28 user nova-compute[72441]:     </memballoon>
Aug 09 19:45:28 user nova-compute[72441]:   </devices>
Aug 09 19:45:28 user nova-compute[72441]: </domain>
Aug 09 19:45:28 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1657982581',display_name='tempest-TestVolumeBootPattern-server-1657982581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1657982581',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-5vxgmnfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:45:19Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=3f6b2156-4e79-4ce7-b489-1f936c87769a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG os_vif [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38f894c-65, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd38f894c-65, col_values=(('external_ids', {'iface-id': 'd38f894c-655b-4833-82a0-a54e69e738f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a1:25', 'vm-uuid': '3f6b2156-4e79-4ce7-b489-1f936c87769a'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:28 user nova-compute[72441]: INFO os_vif [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65')
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:45:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] No VIF found with MAC fa:16:3e:9e:a1:25, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-acbb7f31-a40b-428e-a2b9-1dd0920f804a req-35573b2c-de22-4a5f-a888-6e135e3ffa17 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-acbb7f31-a40b-428e-a2b9-1dd0920f804a req-35573b2c-de22-4a5f-a888-6e135e3ffa17 service nova] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-acbb7f31-a40b-428e-a2b9-1dd0920f804a req-35573b2c-de22-4a5f-a888-6e135e3ffa17 service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-acbb7f31-a40b-428e-a2b9-1dd0920f804a req-35573b2c-de22-4a5f-a888-6e135e3ffa17 service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:29 user nova-compute[72441]: DEBUG nova.compute.manager [req-acbb7f31-a40b-428e-a2b9-1dd0920f804a req-35573b2c-de22-4a5f-a888-6e135e3ffa17 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] No waiting events found dispatching network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:45:29 user nova-compute[72441]: WARNING nova.compute.manager [req-acbb7f31-a40b-428e-a2b9-1dd0920f804a req-35573b2c-de22-4a5f-a888-6e135e3ffa17 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received unexpected event network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 for instance with vm_state building and task_state spawning.
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610331.7557304, 3f6b2156-4e79-4ce7-b489-1f936c87769a => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] VM Resumed (Lifecycle Event)
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Instance spawned successfully.
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610331.757047, 3f6b2156-4e79-4ce7-b489-1f936c87769a => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] VM Started (Lifecycle Event)
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:45:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:31 user nova-compute[72441]: INFO nova.compute.manager [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Took 13.93 seconds to build instance.
Aug 09 19:45:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0b1ac340-aaec-4e4b-a2d3-1a154d1ecc67 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.014s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-5116b408-8c13-453e-8be7-a38cf1a4ac4f req-eff7be36-308d-40ca-85a1-8c06dd7d391e service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5116b408-8c13-453e-8be7-a38cf1a4ac4f req-eff7be36-308d-40ca-85a1-8c06dd7d391e service nova] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5116b408-8c13-453e-8be7-a38cf1a4ac4f req-eff7be36-308d-40ca-85a1-8c06dd7d391e service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5116b408-8c13-453e-8be7-a38cf1a4ac4f req-eff7be36-308d-40ca-85a1-8c06dd7d391e service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:31 user nova-compute[72441]: DEBUG nova.compute.manager [req-5116b408-8c13-453e-8be7-a38cf1a4ac4f req-eff7be36-308d-40ca-85a1-8c06dd7d391e service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] No waiting events found dispatching network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:45:31 user nova-compute[72441]: WARNING nova.compute.manager [req-5116b408-8c13-453e-8be7-a38cf1a4ac4f req-eff7be36-308d-40ca-85a1-8c06dd7d391e service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received unexpected event network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 for instance with vm_state active and task_state None.
Aug 09 19:45:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:37 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:38 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:43 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:45:43 user nova-compute[72441]: INFO nova.compute.claims [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Claim successful on node user
Aug 09 19:45:43 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:45:44 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.policy [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'febf31bc22ae4e00a5e7be7c44708626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb19329778d94a21828a4d3d61d75217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:45:44 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Creating image(s)
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "/opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "/opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "/opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk 1073741824" returned: 0 in 0.050s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Cannot resize image /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'migration_context' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Ensure instance console log exists: /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:44 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Successfully created port: 7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:45:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Successfully updated port: 7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquired lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-changed-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.compute.manager [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Refreshing instance network info cache due to event network-changed-7623f60e-e158-4b4b-975b-440c9732af2f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] Acquiring lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updating instance_info_cache with network_info: [{"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Releasing lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Instance network_info: |[{"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] Acquired lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Refreshing network info cache for port 7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Start _get_guest_xml network_info=[{"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:45:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:45:46 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-12562925',display_name='tempest-AttachVolumeTestJSON-server-12562925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-12562925',id=48,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1zm9ADteI5d8+C8+WCGnJPODypFA3ePsBNLHmacX0vGddfHhZ2lrjFcB+7tjjf+H+lkNOvnOqDpAE3+VMll2YJW4Gy/gDIwolf9SjBD5bY3tJ7m5D4yM4DY6UQqAGgA==',key_name='tempest-keypair-1204238404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-rtseqmev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=8baa5a1c-dd01-458b-96cf-9d726b20e96b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'pci_devices' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:45:46 user nova-compute[72441]:   <uuid>8baa5a1c-dd01-458b-96cf-9d726b20e96b</uuid>
Aug 09 19:45:46 user nova-compute[72441]:   <name>instance-00000030</name>
Aug 09 19:45:46 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:45:46 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:45:46 user nova-compute[72441]:   <metadata>
Aug 09 19:45:46 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:45:46 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:45:46 user nova-compute[72441]:       <nova:name>tempest-AttachVolumeTestJSON-server-12562925</nova:name>
Aug 09 19:45:46 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:45:46</nova:creationTime>
Aug 09 19:45:46 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:45:46 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:45:46 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:45:46 user nova-compute[72441]:       <nova:owner>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:user uuid="febf31bc22ae4e00a5e7be7c44708626">tempest-AttachVolumeTestJSON-333200942-project-member</nova:user>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:project uuid="bb19329778d94a21828a4d3d61d75217">tempest-AttachVolumeTestJSON-333200942</nova:project>
Aug 09 19:45:46 user nova-compute[72441]:       </nova:owner>
Aug 09 19:45:46 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:45:46 user nova-compute[72441]:       <nova:ports>
Aug 09 19:45:46 user nova-compute[72441]:         <nova:port uuid="7623f60e-e158-4b4b-975b-440c9732af2f">
Aug 09 19:45:46 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 19:45:46 user nova-compute[72441]:         </nova:port>
Aug 09 19:45:46 user nova-compute[72441]:       </nova:ports>
Aug 09 19:45:46 user nova-compute[72441]:     </nova:instance>
Aug 09 19:45:46 user nova-compute[72441]:   </metadata>
Aug 09 19:45:46 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:45:46 user nova-compute[72441]:     <system>
Aug 09 19:45:46 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:45:46 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:45:46 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:45:46 user nova-compute[72441]:       <entry name="serial">8baa5a1c-dd01-458b-96cf-9d726b20e96b</entry>
Aug 09 19:45:46 user nova-compute[72441]:       <entry name="uuid">8baa5a1c-dd01-458b-96cf-9d726b20e96b</entry>
Aug 09 19:45:46 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:45:46 user nova-compute[72441]:     </system>
Aug 09 19:45:46 user nova-compute[72441]:   </sysinfo>
Aug 09 19:45:46 user nova-compute[72441]:   <os>
Aug 09 19:45:46 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:45:46 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:45:46 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:45:46 user nova-compute[72441]:   </os>
Aug 09 19:45:46 user nova-compute[72441]:   <features>
Aug 09 19:45:46 user nova-compute[72441]:     <acpi/>
Aug 09 19:45:46 user nova-compute[72441]:     <apic/>
Aug 09 19:45:46 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:45:46 user nova-compute[72441]:   </features>
Aug 09 19:45:46 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:45:46 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:45:46 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:45:46 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:45:46 user nova-compute[72441]:   </clock>
Aug 09 19:45:46 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:45:46 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:45:46 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:45:46 user nova-compute[72441]:   </cpu>
Aug 09 19:45:46 user nova-compute[72441]:   <devices>
Aug 09 19:45:46 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:45:46 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:45:46 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk"/>
Aug 09 19:45:46 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:45:46 user nova-compute[72441]:     </disk>
Aug 09 19:45:46 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:45:46 user nova-compute[72441]:       <mac address="fa:16:3e:38:a3:37"/>
Aug 09 19:45:46 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:45:46 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:45:46 user nova-compute[72441]:       <target dev="tap7623f60e-e1"/>
Aug 09 19:45:46 user nova-compute[72441]:     </interface>
Aug 09 19:45:46 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:45:46 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/console.log" append="off"/>
Aug 09 19:45:46 user nova-compute[72441]:     </serial>
Aug 09 19:45:46 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:45:46 user nova-compute[72441]:     <video>
Aug 09 19:45:46 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:45:46 user nova-compute[72441]:     </video>
Aug 09 19:45:46 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:45:46 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:45:46 user nova-compute[72441]:     </rng>
Aug 09 19:45:46 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:45:46 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:45:46 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:45:46 user nova-compute[72441]:     </memballoon>
Aug 09 19:45:46 user nova-compute[72441]:   </devices>
Aug 09 19:45:46 user nova-compute[72441]: </domain>
Aug 09 19:45:46 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-12562925',display_name='tempest-AttachVolumeTestJSON-server-12562925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-12562925',id=48,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1zm9ADteI5d8+C8+WCGnJPODypFA3ePsBNLHmacX0vGddfHhZ2lrjFcB+7tjjf+H+lkNOvnOqDpAE3+VMll2YJW4Gy/gDIwolf9SjBD5bY3tJ7m5D4yM4DY6UQqAGgA==',key_name='tempest-keypair-1204238404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-rtseqmev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=8baa5a1c-dd01-458b-96cf-9d726b20e96b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG os_vif [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7623f60e-e1, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7623f60e-e1, col_values=(('external_ids', {'iface-id': '7623f60e-e158-4b4b-975b-440c9732af2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:a3:37', 'vm-uuid': '8baa5a1c-dd01-458b-96cf-9d726b20e96b'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:46 user nova-compute[72441]: INFO os_vif [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1')
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No VIF found with MAC fa:16:3e:38:a3:37, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updated VIF entry in instance network info cache for port 7623f60e-e158-4b4b-975b-440c9732af2f. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG nova.network.neutron [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updating instance_info_cache with network_info: [{"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:45:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2ec49418-16d4-4f52-94a9-45bde0d300af req-6708827e-558d-4bba-bddb-ed993dfac452 service nova] Releasing lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-41640e47-3733-4c3f-b323-603a41c4a36a req-105651ff-94b4-4aa5-b873-67f95f18cbfb service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-41640e47-3733-4c3f-b323-603a41c4a36a req-105651ff-94b4-4aa5-b873-67f95f18cbfb service nova] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-41640e47-3733-4c3f-b323-603a41c4a36a req-105651ff-94b4-4aa5-b873-67f95f18cbfb service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-41640e47-3733-4c3f-b323-603a41c4a36a req-105651ff-94b4-4aa5-b873-67f95f18cbfb service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG nova.compute.manager [req-41640e47-3733-4c3f-b323-603a41c4a36a req-105651ff-94b4-4aa5-b873-67f95f18cbfb service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] No waiting events found dispatching network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:45:48 user nova-compute[72441]: WARNING nova.compute.manager [req-41640e47-3733-4c3f-b323-603a41c4a36a req-105651ff-94b4-4aa5-b873-67f95f18cbfb service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received unexpected event network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f for instance with vm_state building and task_state spawning.
Aug 09 19:45:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:45:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:45:49 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:45:49 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8217MB free_disk=25.19144058227539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d3117f89-ee7f-46d9-9cb8-3690a4e2748d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 5b0b69c2-28a7-444f-84ab-f47d63235dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3f6b2156-4e79-4ce7-b489-1f936c87769a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610349.9825284, 8baa5a1c-dd01-458b-96cf-9d726b20e96b => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:45:49 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] VM Resumed (Lifecycle Event)
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:45:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Instance spawned successfully.
Aug 09 19:45:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:45:50 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610349.985973, 8baa5a1c-dd01-458b-96cf-9d726b20e96b => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:45:50 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] VM Started (Lifecycle Event)
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:45:50 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:45:50 user nova-compute[72441]: INFO nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:45:50 user nova-compute[72441]: INFO nova.compute.manager [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Took 6.42 seconds to build instance.
Aug 09 19:45:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4fa5815b-ff9c-4311-9ffa-ca68c7b339a9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.534s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7a6e375-ac3e-4ccd-97eb-05f52462acb4 req-b6231a3a-fede-43d5-a0bb-874c103a32bf service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7a6e375-ac3e-4ccd-97eb-05f52462acb4 req-b6231a3a-fede-43d5-a0bb-874c103a32bf service nova] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7a6e375-ac3e-4ccd-97eb-05f52462acb4 req-b6231a3a-fede-43d5-a0bb-874c103a32bf service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-b7a6e375-ac3e-4ccd-97eb-05f52462acb4 req-b6231a3a-fede-43d5-a0bb-874c103a32bf service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:45:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-b7a6e375-ac3e-4ccd-97eb-05f52462acb4 req-b6231a3a-fede-43d5-a0bb-874c103a32bf service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] No waiting events found dispatching network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:45:50 user nova-compute[72441]: WARNING nova.compute.manager [req-b7a6e375-ac3e-4ccd-97eb-05f52462acb4 req-b6231a3a-fede-43d5-a0bb-874c103a32bf service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received unexpected event network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f for instance with vm_state active and task_state None.
Aug 09 19:45:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:45:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG nova.compute.manager [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing instance network info cache due to event network-changed-7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] Acquiring lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] Acquired lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG nova.network.neutron [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Refreshing network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:05 user nova-compute[72441]: INFO nova.compute.manager [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Terminating instance
Aug 09 19:46:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-127969c9-7237-4274-877c-163f6776c486 req-709983ae-b434-4af7-8f07-61d38d39e534 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-unplugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-127969c9-7237-4274-877c-163f6776c486 req-709983ae-b434-4af7-8f07-61d38d39e534 service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-127969c9-7237-4274-877c-163f6776c486 req-709983ae-b434-4af7-8f07-61d38d39e534 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-127969c9-7237-4274-877c-163f6776c486 req-709983ae-b434-4af7-8f07-61d38d39e534 service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-127969c9-7237-4274-877c-163f6776c486 req-709983ae-b434-4af7-8f07-61d38d39e534 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-unplugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.compute.manager [req-127969c9-7237-4274-877c-163f6776c486 req-709983ae-b434-4af7-8f07-61d38d39e534 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-unplugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updated VIF entry in instance network info cache for port 7f1f2da4-8966-4874-8261-8324c96e8257. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.network.neutron [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [{"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5a22997a-6bfd-469a-a40e-850ff376f89b req-24385251-8718-49f0-b1d7-ccf3d90aac62 service nova] Releasing lock "refresh_cache-5b0b69c2-28a7-444f-84ab-f47d63235dbc" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Instance destroyed successfully.
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lazy-loading 'resources' on Instance uuid 5b0b69c2-28a7-444f-84ab-f47d63235dbc {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T19:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-414112240',display_name='tempest-TestShelveInstance-server-414112240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-414112240',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZFx7vZ5g5Xen3WE00to5BL9o7dbKBges/p9HSNvs37OMnEXgnyF9biWsRr8qexSO+Gup2ZURrb1zRWsHzw+i+hcXKTtkbYh1emOpx8kjwLEw8uoZDUv9Z4cSzoCBfAlA==',key_name='tempest-TestShelveInstance-595052958',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff19d044abd840ab98dac7fe1e20ddc3',ramdisk_id='',reservation_id='r-ynxt8uc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1365792064',owner_user_name='tempest-TestShelveInstance-1365792064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:44:30Z,user_data=None,user_id='cb23b737f92a4b638b43ea8a1d195a5e',uuid=5b0b69c2-28a7-444f-84ab-f47d63235dbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converting VIF {"id": "7f1f2da4-8966-4874-8261-8324c96e8257", "address": "fa:16:3e:d1:de:98", "network": {"id": "8e62530a-d637-48ef-b364-a84ca80f8d8c", "bridge": "br-int", "label": "tempest-TestShelveInstance-499681250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff19d044abd840ab98dac7fe1e20ddc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1f2da4-89", "ovs_interfaceid": "7f1f2da4-8966-4874-8261-8324c96e8257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_vif [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f1f2da4-89, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:46:06 user nova-compute[72441]: INFO os_vif [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:de:98,bridge_name='br-int',has_traffic_filtering=True,id=7f1f2da4-8966-4874-8261-8324c96e8257,network=Network(8e62530a-d637-48ef-b364-a84ca80f8d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1f2da4-89')
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHiwSXLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:46:06 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf309d-62a0-41ea-9dda-6acaa740def7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e67c1c3-8492-42b1-92b0-bb0257df2a7b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:46:06 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:46:06 user nova-compute[72441]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)
Aug 09 19:46:06 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:46:06 user nova-compute[72441]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 (non-flash)
Aug 09 19:46:06 user nova-compute[72441]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)
Aug 09 19:46:06 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905dc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f5ecc-a605-4b40-83f5-6f8e9d55f04c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa86698a-2371-41ac-88d9-9008f29b9615]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cd028e-a8c9-4979-867c-985051aa6daf]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf38f7e-4dc4-4280-a1ab-b6cb6ea49c28]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26464636665393336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43f99ab4', '/dev/disk/by-id/scsi-1SCST_BIO43f99ab4-ddcfe9368d5370aa') {{(pid=83536) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eba120-140d-49dc-bd0b-884d5c569b41]: (4, None) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49521fc-1eb3-476e-87f4-9075ccdff1a6]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c652e2-69ef-4608-94d6-7eca27c17d29]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260]
Aug 09 19:46:06 user nova-compute[72441]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408, portal: 172.16.0.220,3260] successful.
Aug 09 19:46:06 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547c3d8c-2856-4034-9fd0-766d6d9db408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a490f24-0803-408d-aa3c-935b6d91b4f5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] <== disconnect_volume: return (290ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:46:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:46:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Deleting instance files /opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc_del
Aug 09 19:46:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Deletion of /opt/stack/data/nova/instances/5b0b69c2-28a7-444f-84ab-f47d63235dbc_del complete
Aug 09 19:46:07 user nova-compute[72441]: INFO nova.compute.manager [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 19:46:07 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:46:07 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:46:07 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:46:07 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:46:07 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Took 0.52 seconds to deallocate network for instance.
Aug 09 19:46:08 user nova-compute[72441]: INFO nova.compute.manager [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 19:46:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Deleting volume: 547c3d8c-2856-4034-9fd0-766d6d9db408 {{(pid=72441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] Acquiring lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] No waiting events found dispatching network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:46:08 user nova-compute[72441]: WARNING nova.compute.manager [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received unexpected event network-vif-plugged-7f1f2da4-8966-4874-8261-8324c96e8257 for instance with vm_state active and task_state deleting.
Aug 09 19:46:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-3126e896-88bb-4f99-ba6b-ec9fa6b62f9b req-f4f87443-a720-467d-a0b6-efd4e6d8e51d service nova] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Received event network-vif-deleted-7f1f2da4-8966-4874-8261-8324c96e8257 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:08 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Deleted allocations for instance 5b0b69c2-28a7-444f-84ab-f47d63235dbc
Aug 09 19:46:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-734e9c33-8e03-4f37-8e2e-c6505bac01a5 tempest-TestShelveInstance-1365792064 tempest-TestShelveInstance-1365792064-project-member] Lock "5b0b69c2-28a7-444f-84ab-f47d63235dbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:21 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610366.6330585, 5b0b69c2-28a7-444f-84ab-f47d63235dbc => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:46:21 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] VM Stopped (Lifecycle Event)
Aug 09 19:46:21 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e3355dac-6d1f-4ef3-aa29-b66060ab54f0 None None] [instance: 5b0b69c2-28a7-444f-84ab-f47d63235dbc] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:46:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:46:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:46:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:46:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:46:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:39 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:45 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:46:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:46:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:46:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:46:48 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:46:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:46:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:46:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8325MB free_disk=25.162193298339844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d3117f89-ee7f-46d9-9cb8-3690a4e2748d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3f6b2156-4e79-4ce7-b489-1f936c87769a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:46:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:46:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:46:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:46:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-changed-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:47:09 user nova-compute[72441]: DEBUG nova.compute.manager [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Refreshing instance network info cache due to event network-changed-d38f894c-655b-4833-82a0-a54e69e738f7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:47:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] Acquiring lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:47:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] Acquired lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:47:09 user nova-compute[72441]: DEBUG nova.network.neutron [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Refreshing network info cache for port d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updated VIF entry in instance network info cache for port d38f894c-655b-4833-82a0-a54e69e738f7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating instance_info_cache with network_info: [{"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2dde4082-5edf-4a83-b869-088776885e75 req-0e7bb28d-1fdb-4d9a-902e-dba495dec599 service nova] Releasing lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-changed-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG nova.compute.manager [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Refreshing instance network info cache due to event network-changed-d38f894c-655b-4833-82a0-a54e69e738f7. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] Acquiring lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] Acquired lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG nova.network.neutron [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Refreshing network info cache for port d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:10 user nova-compute[72441]: INFO nova.compute.manager [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Terminating instance
Aug 09 19:47:10 user nova-compute[72441]: DEBUG nova.compute.manager [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updated VIF entry in instance network info cache for port d38f894c-655b-4833-82a0-a54e69e738f7. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.network.neutron [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating instance_info_cache with network_info: [{"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-86c460c5-d472-43d3-b725-aaa3db069304 req-6fdf590b-3909-4b97-bd7d-e5452511f934 service nova] Releasing lock "refresh_cache-3f6b2156-4e79-4ce7-b489-1f936c87769a" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:47:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Instance destroyed successfully.
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'resources' on Instance uuid 3f6b2156-4e79-4ce7-b489-1f936c87769a {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1657982581',display_name='tempest-TestVolumeBootPattern-server-1657982581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1657982581',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:45:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-5vxgmnfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:45:32Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=3f6b2156-4e79-4ce7-b489-1f936c87769a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "d38f894c-655b-4833-82a0-a54e69e738f7", "address": "fa:16:3e:9e:a1:25", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38f894c-65", "ovs_interfaceid": "d38f894c-655b-4833-82a0-a54e69e738f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_vif [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38f894c-65, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:11 user nova-compute[72441]: INFO os_vif [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=d38f894c-655b-4833-82a0-a54e69e738f7,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38f894c-65')
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXhlfwOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:47:11 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7bfeab-bf23-4dcb-90e6-595486dd6645]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffcd808-82ee-4a00-8873-8262c3863e3f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:47:11 user nova-compute[72441]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)
Aug 09 19:47:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:47:11 user nova-compute[72441]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b (non-flash)
Aug 09 19:47:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8779ce9-1066-4ebd-b3a0-5c2e064a269f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef2db92-ae94-49a2-8ca4-679cfa10a40d]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa53691-e766-4723-b15a-3d9b331befa3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a93f1e0-05e2-4911-915c-23b6b9848c78]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84f7a37-7e5b-41a7-8cb8-daef59d1bea3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc01c05-118f-4e79-baa4-5d918a8e34b9]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260]
Aug 09 19:47:11 user nova-compute[72441]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b, portal: 172.16.0.220,3260] successful.
Aug 09 19:47:11 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:050d9b4c-3b51-4771-b281-9c6607c4be2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce6b3c-f274-47f3-bc56-5c08afef6bb0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== disconnect_volume: return (284ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:47:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Deleting instance files /opt/stack/data/nova/instances/3f6b2156-4e79-4ce7-b489-1f936c87769a_del
Aug 09 19:47:11 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Deletion of /opt/stack/data/nova/instances/3f6b2156-4e79-4ce7-b489-1f936c87769a_del complete
Aug 09 19:47:11 user nova-compute[72441]: INFO nova.compute.manager [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 09 19:47:11 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:47:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:47:12 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Took 0.48 seconds to deallocate network for instance.
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-153f98e6-b955-46ac-8941-625e6bfc4ee5 req-fc7f1cd1-cb86-4eb8-933c-ee7ffaf01214 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-vif-deleted-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:47:12 user nova-compute[72441]: INFO nova.compute.manager [req-153f98e6-b955-46ac-8941-625e6bfc4ee5 req-fc7f1cd1-cb86-4eb8-933c-ee7ffaf01214 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Neutron deleted interface d38f894c-655b-4833-82a0-a54e69e738f7; detaching it from the instance and deleting it from the info cache
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-153f98e6-b955-46ac-8941-625e6bfc4ee5 req-fc7f1cd1-cb86-4eb8-933c-ee7ffaf01214 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-153f98e6-b955-46ac-8941-625e6bfc4ee5 req-fc7f1cd1-cb86-4eb8-933c-ee7ffaf01214 service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Detach interface failed, port_id=d38f894c-655b-4833-82a0-a54e69e738f7, reason: Instance 3f6b2156-4e79-4ce7-b489-1f936c87769a could not be found. {{(pid=72441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-vif-unplugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] No waiting events found dispatching network-vif-unplugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-vif-unplugged-d38f894c-655b-4833-82a0-a54e69e738f7 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received event network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] Acquiring lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] No waiting events found dispatching network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:47:12 user nova-compute[72441]: WARNING nova.compute.manager [req-ab4e9046-b25e-4607-82bd-a2a2a6d071cb req-ea049077-5349-414e-866e-457e8ebc625d service nova] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Received unexpected event network-vif-plugged-d38f894c-655b-4833-82a0-a54e69e738f7 for instance with vm_state active and task_state deleting.
Aug 09 19:47:13 user nova-compute[72441]: INFO nova.compute.manager [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Took 0.76 seconds to detach 1 volumes for instance.
Aug 09 19:47:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:13 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:47:13 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:47:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:13 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Deleted allocations for instance 3f6b2156-4e79-4ce7-b489-1f936c87769a
Aug 09 19:47:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-ad9e8c6a-62f6-483e-a8aa-6776fb8eb1a0 tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "3f6b2156-4e79-4ce7-b489-1f936c87769a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610431.4732273, 3f6b2156-4e79-4ce7-b489-1f936c87769a => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:47:26 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] VM Stopped (Lifecycle Event)
Aug 09 19:47:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b62be780-e4dc-4133-a89e-6de0ca4333f5 None None] [instance: 3f6b2156-4e79-4ce7-b489-1f936c87769a] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:47:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-changed-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:47:34 user nova-compute[72441]: DEBUG nova.compute.manager [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Refreshing instance network info cache due to event network-changed-7623f60e-e158-4b4b-975b-440c9732af2f. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:47:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] Acquiring lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:47:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] Acquired lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:47:34 user nova-compute[72441]: DEBUG nova.network.neutron [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Refreshing network info cache for port 7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:47:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updated VIF entry in instance network info cache for port 7623f60e-e158-4b4b-975b-440c9732af2f. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:47:35 user nova-compute[72441]: DEBUG nova.network.neutron [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updating instance_info_cache with network_info: [{"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:47:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2023de12-0424-4634-9050-3c1ba3db3367 req-96b753c0-e95c-4e4b-b6a2-0821fc2f845b service nova] Releasing lock "refresh_cache-8baa5a1c-dd01-458b-96cf-9d726b20e96b" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:39 user nova-compute[72441]: INFO nova.compute.manager [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attaching volume 9aa6d760-dc43-486c-87cd-7b8b6f82291c to /dev/vdb
Aug 09 19:47:39 user nova-compute[72441]: DEBUG os_brick.utils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dacdfcd-5396-41af-9faf-2533bee977bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d2951-def0-4352-813d-d1634ae47a0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[194e19c4-2977-44ff-9c0f-f6967b8d0b5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c21da13-074d-487d-9de3-7ae332936969]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:47:39 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:47:39 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bad553-de6c-469a-83a4-61f7276d662a]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG os_brick.utils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:47:39 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updating existing volume attachment record: 82a81db9-eb24-4e9a-8abf-666f2f802bd5 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:47:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:44 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:47:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:47:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:47:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:47:48 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:47:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating instance_info_cache with network_info: [{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:47:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:47:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:47:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:52 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:47:52 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=25.160457611083984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance d3117f89-ee7f-46d9-9cb8-3690a4e2748d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:47:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHeFibru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:47:53 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:47:53 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:47:53 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f6fd75-81fc-4dab-8dff-984e6c60910f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:47:53 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a425f-82e1-48c1-b16b-13e69a6a2fe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c] added
Aug 09 19:47:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecb734c-9bfc-4f3b-9963-2f21fe2b0de4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71fe0ec-97f5-4d51-8a99-8d5332d360ec]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHeFibru {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHeFibru" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6567d219-7bd8-4400-8658-61a4ee4a1fd3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHeFibru'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c185b-139f-48c5-8993-07079043c3e4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5061cd52-6dd6-4737-9bf5-e40615c238fa]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:47:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:47:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de68fd1-0864-4e5b-a598-d0f5cba2fa98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260]
Aug 09 19:47:53 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260] successful.
Aug 09 19:47:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057cfe9-bc55-4701-9142-ddd4fc275d82]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4692ede4-9f32-4e37-8c93-a14e9cf6aaf8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:47:53 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:47:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:47:53 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:47:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5cdf6f-ce81-4b1a-8a64-82d7343a8ee3]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:47:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHeFibru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:47:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:47:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26332653932313462', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:47:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653932313462', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:47:54 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:47:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:47:54 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:47:54 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:47:54 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:47:54 user nova-compute[72441]:   <serial>9aa6d760-dc43-486c-87cd-7b8b6f82291c</serial>
Aug 09 19:47:54 user nova-compute[72441]: </disk>
Aug 09 19:47:54 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:47:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:47:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:47:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No VIF found with MAC fa:16:3e:38:a3:37, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:47:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b280d1a1-ddd7-4980-88c7-b25043246fd9 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.817s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:47:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:47:59 user nova-compute[72441]: INFO nova.compute.manager [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attaching volume 6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 to /dev/vdc
Aug 09 19:47:59 user nova-compute[72441]: DEBUG os_brick.utils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7097d-82ab-44c8-bfef-0b23713b1d7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[901624cc-9eb7-417b-a85b-18003471cd31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9bc820-ddd2-4472-9cd3-5fdfa7c88ba8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a7e20-2aec-40a7-8c10-e3fb01d7021c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:47:59 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:47:59 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[caffe1d4-063a-45f2-8be7-88a77cdc361b]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG os_brick.utils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:47:59 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updating existing volume attachment record: efaaeb77-793a-4827-bd05-54d84e5508c2 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:48:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbmqjJfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:48:08 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:48:08 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:48:08 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41262667-1d79-4bf1-bd32-a03f185c71c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:48:08 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06342db-de06-4511-ac75-82fc4831f4cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78] added
Aug 09 19:48:08 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a112b9-afb3-4c93-a89f-17c179132e2d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[835c7d15-68e7-446c-8bae-5769ad1b7e28]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbmqjJfl {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbmqjJfl" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6efe062-bd48-4056-ae8b-af2a52e1e5b0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbmqjJfl'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[269fef0c-697e-4fe0-af3e-3a12481ce2e7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed46474-36a5-4789-a2b9-781d13c5ee00]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:08 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:48:08 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:08 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:48:08 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724ff6c-fea0-401a-a7ff-c1f13015fd11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260]
Aug 09 19:48:08 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260] successful.
Aug 09 19:48:08 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb81ba1-d822-4e5a-b8ee-00a2e5a19a74]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e2534-44af-425c-8b9b-14a8a6c3709d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:08 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:48:08 user nova-compute[72441]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:08 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:08 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:48:08 user nova-compute[72441]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:08 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559a152-4d20-48db-a2c2-558ef59bffdb]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:48:08 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbmqjJfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:48:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:48:09 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26638353766333739', 'path': '/dev/sdd'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:48:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353766333739', 'path': '/dev/sdd'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:48:09 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:48:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:48:09 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:48:09 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:48:09 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:48:09 user nova-compute[72441]:   <serial>6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78</serial>
Aug 09 19:48:09 user nova-compute[72441]: </disk>
Aug 09 19:48:09 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:48:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:48:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:48:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:48:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] No VIF found with MAC fa:16:3e:38:a3:37, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:48:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd4f0843-7fdb-4b26-a22b-806ec494d213 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.651s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:11 user nova-compute[72441]: INFO nova.compute.manager [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Detaching volume 9aa6d760-dc43-486c-87cd-7b8b6f82291c
Aug 09 19:48:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:11 user nova-compute[72441]: INFO nova.virt.block_device [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attempting to driver detach volume 9aa6d760-dc43-486c-87cd-7b8b6f82291c from mountpoint /dev/vdb
Aug 09 19:48:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Attempting to detach device vdb from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:48:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:48:11 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:48:11 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:48:11 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:48:11 user nova-compute[72441]:   <serial>9aa6d760-dc43-486c-87cd-7b8b6f82291c</serial>
Aug 09 19:48:11 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:48:11 user nova-compute[72441]: </disk>
Aug 09 19:48:11 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:48:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully detached device vdb from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the persistent domain config.
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:48:12 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:48:12 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:48:12 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:48:12 user nova-compute[72441]:   <serial>9aa6d760-dc43-486c-87cd-7b8b6f82291c</serial>
Aug 09 19:48:12 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:48:12 user nova-compute[72441]: </disk>
Aug 09 19:48:12 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610492.43607, 8baa5a1c-dd01-458b-96cf-9d726b20e96b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:48:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully detached device vdb from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the live domain config.
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHeFibru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:48:12 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-changed-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.compute.manager [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Refreshing instance network info cache due to event network-changed-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] Acquiring lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] Acquired lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.network.neutron [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Refreshing network info cache for port 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb88c5-a35a-4df4-b384-7a22fc116b7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc06879f-4689-4e1b-a258-cee2dad6fa25]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:12 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:48:12 user nova-compute[72441]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:12 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:12 user nova-compute[72441]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c (non-flash)
Aug 09 19:48:12 user nova-compute[72441]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:12 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9022cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf568fa-b533-4722-bdfe-1681d032c7b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fcce67-5d30-4705-b578-734196505449]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8d11c-69c4-4945-b21e-bda1ab2c7d38]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:48:12 user nova-compute[72441]: INFO nova.compute.manager [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Terminating instance
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[64201e69-9d19-4967-8e3e-7728da94bf6a]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03cb5c5-9eae-430d-9995-85f085f60314]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4b4f1-ab3c-4158-8092-64a004493984]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260]
Aug 09 19:48:12 user nova-compute[72441]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c, portal: 172.16.0.220,3260] successful.
Aug 09 19:48:12 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa6d760-dc43-486c-87cd-7b8b6f82291c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34fc1f0-07db-4bd8-b095-9ca73f0e42a4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== disconnect_volume: return (331ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:48:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updated VIF entry in instance network info cache for port 65a853a0-afe5-42e8-ae41-2e5dbb79a2c4. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.network.neutron [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating instance_info_cache with network_info: [{"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-1ce6418f-37c2-4170-b9e6-afacd38c9c13 req-100189cc-63ba-4802-ac3c-af3221f95179 service nova] Releasing lock "refresh_cache-d3117f89-ee7f-46d9-9cb8-3690a4e2748d" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:48:13 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Instance destroyed successfully.
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lazy-loading 'resources' on Instance uuid d3117f89-ee7f-46d9-9cb8-3690a4e2748d {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1304580252',display_name='tempest-TestVolumeBootPattern-server-1304580252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1304580252',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiyGC4Y84oUsH+ekSZwfs7MeASJ5WAqDJ8McId0hxFw/RDEgOEOBLPtwkdWjb3d/eHvCo+MW5kXJYpm7QEndOWtjBcDZo2MsmAltj7nMgIH6nJGEWzmsPewf4bezHoh8w==',key_name='tempest-TestVolumeBootPattern-1531822966',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256ae81254564eadaf8042330cb1fdce',ramdisk_id='',reservation_id='r-3ff9lit0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1486219267',owner_user_name='tempest-TestVolumeBootPattern-1486219267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:43:28Z,user_data=None,user_id='0fd066b4d22049d0b2129ad1f38ef9e4',uuid=d3117f89-ee7f-46d9-9cb8-3690a4e2748d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converting VIF {"id": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "address": "fa:16:3e:2e:a4:a1", "network": {"id": "8c9677e4-c717-4ff2-8ca1-b35ae02cb865", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1125099114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256ae81254564eadaf8042330cb1fdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a853a0-af", "ovs_interfaceid": "65a853a0-afe5-42e8-ae41-2e5dbb79a2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_vif [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65a853a0-af, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:13 user nova-compute[72441]: INFO os_vif [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a4:a1,bridge_name='br-int',has_traffic_filtering=True,id=65a853a0-afe5-42e8-ae41-2e5dbb79a2c4,network=Network(8c9677e4-c717-4ff2-8ca1-b35ae02cb865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a853a0-af')
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqJCUlkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:48:13 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5e7f0-3110-4fc1-ba43-8637fea723a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcbf97c-d7e2-46c1-b8cc-2e3249f8b887]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:13 user nova-compute[72441]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:13 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 (non-flash)
Aug 09 19:48:13 user nova-compute[72441]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:13 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984fdcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8963cc23-8502-4ad5-bf38-8eab6bdff7a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f12d4e-66db-48e4-929f-e23afa40c472]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a94bd-e5a3-4525-bbb4-134570530615]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[981eb8d1-ace3-454e-818b-cfcd85e2d2ea]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3785d65', '/dev/disk/by-id/scsi-1SCST_BIO3785d65-214a37649b3b4713', '/dev/disk/by-id/scsi-23231346133373634') {{(pid=83536) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb9b70c-d241-4988-8f3b-d70ff5198aa0]: (4, None) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8ea78-a743-4f06-9ae1-a4103db177f3]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5d948114-ef65-40ff-8aff-99bcceb3e5b4 tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.700s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74313386-a3a7-4cd2-b304-4bf512ad5ce8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260]
Aug 09 19:48:13 user nova-compute[72441]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972, portal: 172.16.0.220,3260] successful.
Aug 09 19:48:13 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c1d2544-9373-4871-808f-0cb5c141d972 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca01ee43-dc2f-45c2-9583-68013eb9d85a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] <== disconnect_volume: return (311ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:48:13 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Deleting instance files /opt/stack/data/nova/instances/d3117f89-ee7f-46d9-9cb8-3690a4e2748d_del
Aug 09 19:48:13 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Deletion of /opt/stack/data/nova/instances/d3117f89-ee7f-46d9-9cb8-3690a4e2748d_del complete
Aug 09 19:48:13 user nova-compute[72441]: INFO nova.compute.manager [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 19:48:13 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:48:13 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:14 user nova-compute[72441]: INFO nova.compute.manager [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Detaching volume 6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78
Aug 09 19:48:14 user nova-compute[72441]: INFO nova.virt.block_device [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Attempting to driver detach volume 6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 from mountpoint /dev/vdc
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Attempting to detach device vdc from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:48:14 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:48:14 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:48:14 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:48:14 user nova-compute[72441]:   <serial>6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78</serial>
Aug 09 19:48:14 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 19:48:14 user nova-compute[72441]: </disk>
Aug 09 19:48:14 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:48:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully detached device vdc from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the persistent domain config.
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:48:14 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:48:14 user nova-compute[72441]:   <source dev="/dev/sdd"/>
Aug 09 19:48:14 user nova-compute[72441]:   <target dev="vdc" bus="virtio"/>
Aug 09 19:48:14 user nova-compute[72441]:   <serial>6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78</serial>
Aug 09 19:48:14 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 19:48:14 user nova-compute[72441]: </disk>
Aug 09 19:48:14 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-vif-unplugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] No waiting events found dispatching network-vif-unplugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-vif-unplugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] Acquiring lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.compute.manager [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] No waiting events found dispatching network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:48:14 user nova-compute[72441]: WARNING nova.compute.manager [req-7f3f6740-db67-4638-908a-588b04492770 req-ab8ce431-a740-4066-b42c-cc56cd9300ef service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received unexpected event network-vif-plugged-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 for instance with vm_state active and task_state deleting.
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:48:14 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Took 0.83 seconds to deallocate network for instance.
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610494.8224561, 8baa5a1c-dd01-458b-96cf-9d726b20e96b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:48:14 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully detached device vdc from instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b from the live domain config.
Aug 09 19:48:14 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbmqjJfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:48:14 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d38256-4d3a-4381-9454-361bb8354fcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e347189-0d2e-4910-b28f-32cd944f49d5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 (non-flash)
Aug 09 19:48:14 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984ffa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78'): ({'sdd'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Removing single pathed devices sdd {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bde30e-e552-44e3-8df6-4090714edb4d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f347311-1743-4934-ab77-27eef185abf8]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Flushing IO for device /dev/sdd {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd2c813-5a99-4b5e-b61a-6d36021998be]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe0ba33-1fba-451b-8d37-e9c74dea6e75]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] SCSI volumes sdd have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[975624f1-8901-45d7-8ccd-366da34d8c25]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:14 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee8980-23a4-4e8a-9689-cff9c1f519cf]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260]
Aug 09 19:48:15 user nova-compute[72441]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78, portal: 172.16.0.220,3260] successful.
Aug 09 19:48:15 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b59fd61-3fa6-4bbd-8dc1-394b7bdd0e78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a6a37-c898-4ea5-b6a6-aba25d1e7e73]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.232s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] <== disconnect_volume: return (233ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:48:15 user nova-compute[72441]: INFO nova.compute.manager [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Took 0.77 seconds to detach 1 volumes for instance.
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:15 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Deleted allocations for instance d3117f89-ee7f-46d9-9cb8-3690a4e2748d
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-bdfe4dbb-da4e-4a50-8b86-08fcb38f7f1b tempest-TestVolumeBootPattern-1486219267 tempest-TestVolumeBootPattern-1486219267-project-member] Lock "d3117f89-ee7f-46d9-9cb8-3690a4e2748d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.123s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'flavor' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:48:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac2-2340-404f-861d-93e174af234b tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG nova.compute.manager [req-719bf0f3-e884-46ec-b5d5-bee2b3dcaaff req-fc9753f4-1b25-4a5c-8051-fd6e74b38e36 service nova] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Received event network-vif-deleted-65a853a0-afe5-42e8-ae41-2e5dbb79a2c4 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:16 user nova-compute[72441]: INFO nova.compute.manager [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Terminating instance
Aug 09 19:48:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-2e00cc48-4127-4949-9ac4-c0c10f54c5d0 req-581a17bd-4739-4114-8124-8390097d01fc service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-vif-unplugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2e00cc48-4127-4949-9ac4-c0c10f54c5d0 req-581a17bd-4739-4114-8124-8390097d01fc service nova] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2e00cc48-4127-4949-9ac4-c0c10f54c5d0 req-581a17bd-4739-4114-8124-8390097d01fc service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2e00cc48-4127-4949-9ac4-c0c10f54c5d0 req-581a17bd-4739-4114-8124-8390097d01fc service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-2e00cc48-4127-4949-9ac4-c0c10f54c5d0 req-581a17bd-4739-4114-8124-8390097d01fc service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] No waiting events found dispatching network-vif-unplugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-2e00cc48-4127-4949-9ac4-c0c10f54c5d0 req-581a17bd-4739-4114-8124-8390097d01fc service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-vif-unplugged-7623f60e-e158-4b4b-975b-440c9732af2f for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:48:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Instance destroyed successfully.
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.objects.instance [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lazy-loading 'resources' on Instance uuid 8baa5a1c-dd01-458b-96cf-9d726b20e96b {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-12562925',display_name='tempest-AttachVolumeTestJSON-server-12562925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-12562925',id=48,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1zm9ADteI5d8+C8+WCGnJPODypFA3ePsBNLHmacX0vGddfHhZ2lrjFcB+7tjjf+H+lkNOvnOqDpAE3+VMll2YJW4Gy/gDIwolf9SjBD5bY3tJ7m5D4yM4DY6UQqAGgA==',key_name='tempest-keypair-1204238404',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb19329778d94a21828a4d3d61d75217',ramdisk_id='',reservation_id='r-rtseqmev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333200942',owner_user_name='tempest-AttachVolumeTestJSON-333200942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='febf31bc22ae4e00a5e7be7c44708626',uuid=8baa5a1c-dd01-458b-96cf-9d726b20e96b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converting VIF {"id": "7623f60e-e158-4b4b-975b-440c9732af2f", "address": "fa:16:3e:38:a3:37", "network": {"id": "b1aa5813-d121-4c10-8ab9-d5ae8d25ca01", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-96008752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb19329778d94a21828a4d3d61d75217", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7623f60e-e1", "ovs_interfaceid": "7623f60e-e158-4b4b-975b-440c9732af2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG os_vif [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7623f60e-e1, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:17 user nova-compute[72441]: INFO os_vif [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:a3:37,bridge_name='br-int',has_traffic_filtering=True,id=7623f60e-e158-4b4b-975b-440c9732af2f,network=Network(b1aa5813-d121-4c10-8ab9-d5ae8d25ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7623f60e-e1')
Aug 09 19:48:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Deleting instance files /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b_del
Aug 09 19:48:17 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Deletion of /opt/stack/data/nova/instances/8baa5a1c-dd01-458b-96cf-9d726b20e96b_del complete
Aug 09 19:48:17 user nova-compute[72441]: INFO nova.compute.manager [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 19:48:17 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:48:17 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:48:18 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:48:18 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Took 0.78 seconds to deallocate network for instance.
Aug 09 19:48:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-2cd240a4-157a-4a50-84ee-7a69867e769c req-1f2aeec4-29c0-41c2-8e41-786facd19f48 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-vif-deleted-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:18 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:48:18 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:48:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:18 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Deleted allocations for instance 8baa5a1c-dd01-458b-96cf-9d726b20e96b
Aug 09 19:48:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-a8d6a82c-54e1-4b0e-ac3c-91d264a0324a tempest-AttachVolumeTestJSON-333200942 tempest-AttachVolumeTestJSON-333200942-project-member] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-0e4406e5-08e7-4ddf-b09b-952d9c78bd39 req-92fca8cb-4210-48c0-a3a6-510425d4ca00 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received event network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:48:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0e4406e5-08e7-4ddf-b09b-952d9c78bd39 req-92fca8cb-4210-48c0-a3a6-510425d4ca00 service nova] Acquiring lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0e4406e5-08e7-4ddf-b09b-952d9c78bd39 req-92fca8cb-4210-48c0-a3a6-510425d4ca00 service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-0e4406e5-08e7-4ddf-b09b-952d9c78bd39 req-92fca8cb-4210-48c0-a3a6-510425d4ca00 service nova] Lock "8baa5a1c-dd01-458b-96cf-9d726b20e96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:19 user nova-compute[72441]: DEBUG nova.compute.manager [req-0e4406e5-08e7-4ddf-b09b-952d9c78bd39 req-92fca8cb-4210-48c0-a3a6-510425d4ca00 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] No waiting events found dispatching network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:48:19 user nova-compute[72441]: WARNING nova.compute.manager [req-0e4406e5-08e7-4ddf-b09b-952d9c78bd39 req-92fca8cb-4210-48c0-a3a6-510425d4ca00 service nova] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Received unexpected event network-vif-plugged-7623f60e-e158-4b4b-975b-440c9732af2f for instance with vm_state deleted and task_state None.
Aug 09 19:48:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:48:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:48:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:48:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:28 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610493.3309093, d3117f89-ee7f-46d9-9cb8-3690a4e2748d => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:48:28 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] VM Stopped (Lifecycle Event)
Aug 09 19:48:28 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6986fe2f-d3ec-460e-a861-9b45f33cfdf6 None None] [instance: d3117f89-ee7f-46d9-9cb8-3690a4e2748d] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:48:32 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610497.6946704, 8baa5a1c-dd01-458b-96cf-9d726b20e96b => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:48:32 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] VM Stopped (Lifecycle Event)
Aug 09 19:48:32 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d9b2dcbe-16d5-480a-949b-1afcee3655f5 None None] [instance: 8baa5a1c-dd01-458b-96cf-9d726b20e96b] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:48:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:42 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:48:42 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:48:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:43 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:46 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:48:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:48:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 6b04a9f9-5403-443c-99f5-122bb3d2d117 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:48:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:48:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:48:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:48:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:48:51 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:48:52 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:48:52 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=25.178707122802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:48:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:48:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:48:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:48:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:49:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:49:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:49:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:49:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:49:36 user nova-compute[72441]: INFO nova.compute.claims [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Claim successful on node user
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:49:36 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:49:37 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.policy [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c9f89b9bdc04a5ba2dec4ae86037907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92376d6d9f604e8d8b36ce2bb581eb10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:49:37 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Creating image(s)
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "/opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "/opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk 1073741824" returned: 0 in 0.065s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Cannot resize image /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'migration_context' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Ensure instance console log exists: /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:37 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Successfully created port: 1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Successfully updated port: 1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-changed-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG nova.compute.manager [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Refreshing instance network info cache due to event network-changed-1031687e-75ae-48d9-b4d9-0d4d519b5857. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:49:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.network.neutron [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Instance network_info: |[{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.network.neutron [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Refreshing network info cache for port 1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Start _get_guest_xml network_info=[{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:49:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:49:39 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:49:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1585515408',display_name='tempest-SnapshotDataIntegrityTests-server-1585515408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1585515408',id=49,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLafFTwaiLZCcH5vt+FZtx07bRuKKmNsnqMu5XmtIZn33U/sMaZi14AmW46bPPnVa+tj7U3lvSY73zUQ6H6v7q+W6I9GyPRnv+jAfhzdBRHh259EnSvhVuHrQYZ+SPatlA==',key_name='tempest-keypair-1313069414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92376d6d9f604e8d8b36ce2bb581eb10',ramdisk_id='',reservation_id='r-7ud64qcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-122337818',owner_user_name='tempest-SnapshotDataIntegrityTests-122337818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9f89b9bdc04a5ba2dec4ae86037907',uuid=3e34f59c-b983-4ad9-a817-36bdfb9d17f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Converting VIF {"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.objects.instance [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:49:39 user nova-compute[72441]:   <uuid>3e34f59c-b983-4ad9-a817-36bdfb9d17f8</uuid>
Aug 09 19:49:39 user nova-compute[72441]:   <name>instance-00000031</name>
Aug 09 19:49:39 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:49:39 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:49:39 user nova-compute[72441]:   <metadata>
Aug 09 19:49:39 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:49:39 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:49:39 user nova-compute[72441]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1585515408</nova:name>
Aug 09 19:49:39 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:49:39</nova:creationTime>
Aug 09 19:49:39 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:49:39 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:49:39 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:49:39 user nova-compute[72441]:       <nova:owner>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:user uuid="8c9f89b9bdc04a5ba2dec4ae86037907">tempest-SnapshotDataIntegrityTests-122337818-project-member</nova:user>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:project uuid="92376d6d9f604e8d8b36ce2bb581eb10">tempest-SnapshotDataIntegrityTests-122337818</nova:project>
Aug 09 19:49:39 user nova-compute[72441]:       </nova:owner>
Aug 09 19:49:39 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:49:39 user nova-compute[72441]:       <nova:ports>
Aug 09 19:49:39 user nova-compute[72441]:         <nova:port uuid="1031687e-75ae-48d9-b4d9-0d4d519b5857">
Aug 09 19:49:39 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 19:49:39 user nova-compute[72441]:         </nova:port>
Aug 09 19:49:39 user nova-compute[72441]:       </nova:ports>
Aug 09 19:49:39 user nova-compute[72441]:     </nova:instance>
Aug 09 19:49:39 user nova-compute[72441]:   </metadata>
Aug 09 19:49:39 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:49:39 user nova-compute[72441]:     <system>
Aug 09 19:49:39 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:49:39 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:49:39 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:49:39 user nova-compute[72441]:       <entry name="serial">3e34f59c-b983-4ad9-a817-36bdfb9d17f8</entry>
Aug 09 19:49:39 user nova-compute[72441]:       <entry name="uuid">3e34f59c-b983-4ad9-a817-36bdfb9d17f8</entry>
Aug 09 19:49:39 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:49:39 user nova-compute[72441]:     </system>
Aug 09 19:49:39 user nova-compute[72441]:   </sysinfo>
Aug 09 19:49:39 user nova-compute[72441]:   <os>
Aug 09 19:49:39 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:49:39 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:49:39 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:49:39 user nova-compute[72441]:   </os>
Aug 09 19:49:39 user nova-compute[72441]:   <features>
Aug 09 19:49:39 user nova-compute[72441]:     <acpi/>
Aug 09 19:49:39 user nova-compute[72441]:     <apic/>
Aug 09 19:49:39 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:49:39 user nova-compute[72441]:   </features>
Aug 09 19:49:39 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:49:39 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:49:39 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:49:39 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:49:39 user nova-compute[72441]:   </clock>
Aug 09 19:49:39 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:49:39 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:49:39 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:49:39 user nova-compute[72441]:   </cpu>
Aug 09 19:49:39 user nova-compute[72441]:   <devices>
Aug 09 19:49:39 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:49:39 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:49:39 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk"/>
Aug 09 19:49:39 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:49:39 user nova-compute[72441]:     </disk>
Aug 09 19:49:39 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:49:39 user nova-compute[72441]:       <mac address="fa:16:3e:47:64:24"/>
Aug 09 19:49:39 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:49:39 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:49:39 user nova-compute[72441]:       <target dev="tap1031687e-75"/>
Aug 09 19:49:39 user nova-compute[72441]:     </interface>
Aug 09 19:49:39 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:49:39 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/console.log" append="off"/>
Aug 09 19:49:39 user nova-compute[72441]:     </serial>
Aug 09 19:49:39 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:49:39 user nova-compute[72441]:     <video>
Aug 09 19:49:39 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:49:39 user nova-compute[72441]:     </video>
Aug 09 19:49:39 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:49:39 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:49:39 user nova-compute[72441]:     </rng>
Aug 09 19:49:39 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:49:39 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:49:39 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:49:39 user nova-compute[72441]:     </memballoon>
Aug 09 19:49:39 user nova-compute[72441]:   </devices>
Aug 09 19:49:39 user nova-compute[72441]: </domain>
Aug 09 19:49:39 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:49:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1585515408',display_name='tempest-SnapshotDataIntegrityTests-server-1585515408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1585515408',id=49,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLafFTwaiLZCcH5vt+FZtx07bRuKKmNsnqMu5XmtIZn33U/sMaZi14AmW46bPPnVa+tj7U3lvSY73zUQ6H6v7q+W6I9GyPRnv+jAfhzdBRHh259EnSvhVuHrQYZ+SPatlA==',key_name='tempest-keypair-1313069414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92376d6d9f604e8d8b36ce2bb581eb10',ramdisk_id='',reservation_id='r-7ud64qcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-122337818',owner_user_name='tempest-SnapshotDataIntegrityTests-122337818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9f89b9bdc04a5ba2dec4ae86037907',uuid=3e34f59c-b983-4ad9-a817-36bdfb9d17f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Converting VIF {"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG os_vif [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1031687e-75, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1031687e-75, col_values=(('external_ids', {'iface-id': '1031687e-75ae-48d9-b4d9-0d4d519b5857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:64:24', 'vm-uuid': '3e34f59c-b983-4ad9-a817-36bdfb9d17f8'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:39 user nova-compute[72441]: INFO os_vif [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75')
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:49:39 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No VIF found with MAC fa:16:3e:47:64:24, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated VIF entry in instance network info cache for port 1031687e-75ae-48d9-b4d9-0d4d519b5857. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-55975684-10fd-4d3e-a805-d709dce46749 req-86a67f6f-fd49-442d-9ac8-92cb85dedb47 service nova] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-4c012e8e-1766-4b33-a86d-f260a61bc5da req-d77e4dd2-96a1-4162-a477-fa9fdd0948bc service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4c012e8e-1766-4b33-a86d-f260a61bc5da req-d77e4dd2-96a1-4162-a477-fa9fdd0948bc service nova] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4c012e8e-1766-4b33-a86d-f260a61bc5da req-d77e4dd2-96a1-4162-a477-fa9fdd0948bc service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4c012e8e-1766-4b33-a86d-f260a61bc5da req-d77e4dd2-96a1-4162-a477-fa9fdd0948bc service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-4c012e8e-1766-4b33-a86d-f260a61bc5da req-d77e4dd2-96a1-4162-a477-fa9fdd0948bc service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] No waiting events found dispatching network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:49:40 user nova-compute[72441]: WARNING nova.compute.manager [req-4c012e8e-1766-4b33-a86d-f260a61bc5da req-d77e4dd2-96a1-4162-a477-fa9fdd0948bc service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received unexpected event network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 for instance with vm_state building and task_state spawning.
Aug 09 19:49:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:42 user nova-compute[72441]: DEBUG nova.compute.manager [req-2e943d25-287e-446c-b425-e7e000b246e5 req-bf62de9e-3789-4738-8ce9-43f70935e322 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2e943d25-287e-446c-b425-e7e000b246e5 req-bf62de9e-3789-4738-8ce9-43f70935e322 service nova] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2e943d25-287e-446c-b425-e7e000b246e5 req-bf62de9e-3789-4738-8ce9-43f70935e322 service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2e943d25-287e-446c-b425-e7e000b246e5 req-bf62de9e-3789-4738-8ce9-43f70935e322 service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [req-2e943d25-287e-446c-b425-e7e000b246e5 req-bf62de9e-3789-4738-8ce9-43f70935e322 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] No waiting events found dispatching network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:49:43 user nova-compute[72441]: WARNING nova.compute.manager [req-2e943d25-287e-446c-b425-e7e000b246e5 req-bf62de9e-3789-4738-8ce9-43f70935e322 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received unexpected event network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 for instance with vm_state building and task_state spawning.
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610583.059315, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] VM Resumed (Lifecycle Event)
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Instance spawned successfully.
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610583.0613966, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] VM Started (Lifecycle Event)
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 09 19:49:43 user nova-compute[72441]: DEBUG nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:49:43 user nova-compute[72441]: INFO nova.compute.manager [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Took 6.61 seconds to build instance.
Aug 09 19:49:43 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-9532eb34-81dc-4165-9056-2fd990079e44 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.719s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:45 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:46 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:49:49 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 6b04a9f9-5403-443c-99f5-122bb3d2d117 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:49:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [{"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:49:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-6b04a9f9-5403-443c-99f5-122bb3d2d117" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:49:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:49:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:54 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:49:54 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=25.166400909423828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 6b04a9f9-5403-443c-99f5-122bb3d2d117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:49:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:56 user nova-compute[72441]: INFO nova.compute.manager [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Terminating instance
Aug 09 19:49:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-45613068-c29e-44fd-947b-6f6449a54685 req-f460a1f5-1f10-449b-8d75-65d50ca7dd32 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-vif-unplugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-45613068-c29e-44fd-947b-6f6449a54685 req-f460a1f5-1f10-449b-8d75-65d50ca7dd32 service nova] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-45613068-c29e-44fd-947b-6f6449a54685 req-f460a1f5-1f10-449b-8d75-65d50ca7dd32 service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-45613068-c29e-44fd-947b-6f6449a54685 req-f460a1f5-1f10-449b-8d75-65d50ca7dd32 service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-45613068-c29e-44fd-947b-6f6449a54685 req-f460a1f5-1f10-449b-8d75-65d50ca7dd32 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] No waiting events found dispatching network-vif-unplugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-45613068-c29e-44fd-947b-6f6449a54685 req-f460a1f5-1f10-449b-8d75-65d50ca7dd32 service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-vif-unplugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:49:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Instance destroyed successfully.
Aug 09 19:49:57 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lazy-loading 'resources' on Instance uuid 6b04a9f9-5403-443c-99f5-122bb3d2d117 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1759903287',display_name='tempest-ServersNegativeTestJSON-server-1759903287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1759903287',id=44,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:41:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61244bcc605b44c393b346ad4c7ff324',ramdisk_id='',reservation_id='r-utkhq481',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-957430953',owner_user_name='tempest-ServersNegativeTestJSON-957430953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:41:12Z,user_data=None,user_id='523ae2e0c78f4b289d9633deea37011c',uuid=6b04a9f9-5403-443c-99f5-122bb3d2d117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converting VIF {"id": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "address": "fa:16:3e:26:ec:1c", "network": {"id": "d4ee7ed6-3621-4a10-a899-34991a58f77f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-425292409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61244bcc605b44c393b346ad4c7ff324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf546cb1e-58", "ovs_interfaceid": "f546cb1e-58f8-4690-ad3d-0e07e9175ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG os_vif [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf546cb1e-58, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:49:57 user nova-compute[72441]: INFO os_vif [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ec:1c,bridge_name='br-int',has_traffic_filtering=True,id=f546cb1e-58f8-4690-ad3d-0e07e9175ca2,network=Network(d4ee7ed6-3621-4a10-a899-34991a58f77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf546cb1e-58')
Aug 09 19:49:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Deleting instance files /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117_del
Aug 09 19:49:57 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Deletion of /opt/stack/data/nova/instances/6b04a9f9-5403-443c-99f5-122bb3d2d117_del complete
Aug 09 19:49:57 user nova-compute[72441]: INFO nova.compute.manager [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 19:49:57 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:49:57 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:49:58 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Took 0.88 seconds to deallocate network for instance.
Aug 09 19:49:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-c23317f0-c047-4501-993e-6137ab553d26 req-9b9ec85d-b308-4f09-a664-970aa0461b2f service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-vif-deleted-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:58 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Deleted allocations for instance 6b04a9f9-5403-443c-99f5-122bb3d2d117
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4ad8c06c-facf-42d5-be72-0b238ada85a1 tempest-ServersNegativeTestJSON-957430953 tempest-ServersNegativeTestJSON-957430953-project-member] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.126s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-5e46e9fa-3a3c-42ce-816f-8af4246de40e req-4a048bcb-b6bb-4a58-b142-4aee738ad1de service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received event network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5e46e9fa-3a3c-42ce-816f-8af4246de40e req-4a048bcb-b6bb-4a58-b142-4aee738ad1de service nova] Acquiring lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5e46e9fa-3a3c-42ce-816f-8af4246de40e req-4a048bcb-b6bb-4a58-b142-4aee738ad1de service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5e46e9fa-3a3c-42ce-816f-8af4246de40e req-4a048bcb-b6bb-4a58-b142-4aee738ad1de service nova] Lock "6b04a9f9-5403-443c-99f5-122bb3d2d117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:49:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-5e46e9fa-3a3c-42ce-816f-8af4246de40e req-4a048bcb-b6bb-4a58-b142-4aee738ad1de service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] No waiting events found dispatching network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:49:58 user nova-compute[72441]: WARNING nova.compute.manager [req-5e46e9fa-3a3c-42ce-816f-8af4246de40e req-4a048bcb-b6bb-4a58-b142-4aee738ad1de service nova] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Received unexpected event network-vif-plugged-f546cb1e-58f8-4690-ad3d-0e07e9175ca2 for instance with vm_state deleted and task_state None.
Aug 09 19:50:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:12 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610597.0800657, 6b04a9f9-5403-443c-99f5-122bb3d2d117 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:50:12 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] VM Stopped (Lifecycle Event)
Aug 09 19:50:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-27d4a90f-b794-466c-bb59-8ab68a9a207f None None] [instance: 6b04a9f9-5403-443c-99f5-122bb3d2d117] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:50:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:50:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:50:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:50:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:50:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:50:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:50:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:50:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:50:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:50:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:50:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:53 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:50:53 user nova-compute[72441]: INFO nova.compute.claims [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Claim successful on node user
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:50:54 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.policy [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05c741becd3a45c98e07e9d5ad726eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af2214a97a24954875afbb048732bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:50:54 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Creating image(s)
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "/opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "/opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "/opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.172s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk 1073741824" returned: 0 in 0.059s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Successfully created port: 9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.435s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:50:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:50:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.163169860839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 99a88fab-2227-4843-b2ce-a777b481023f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Cannot resize image /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'migration_context' on Instance uuid 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Ensure instance console log exists: /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:50:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Successfully updated port: 9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquired lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-changed-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Refreshing instance network info cache due to event network-changed-9807736e-04b5-4dd5-b8ad-b42a63e95947. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] Acquiring lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updating instance_info_cache with network_info: [{"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Releasing lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Instance network_info: |[{"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] Acquired lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Refreshing network info cache for port 9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Start _get_guest_xml network_info=[{"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:50:56 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:50:56 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-629662610',display_name='tempest-VolumesSnapshotTestJSON-instance-629662610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-629662610',id=50,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7Ge+SAh0ZU5Xo2j2DJv2+aAdPRwKoORKafZ3KFpu3aN++VXYJ+RLOxOAQQBilJKZEimAS3x04tx8lbiXu4Tr9Yb7NyZrS3zhrGalwyJT3aJVJ8lr54HvvscBKihUGGAg==',key_name='tempest-keypair-1278308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af2214a97a24954875afbb048732bfe',ramdisk_id='',reservation_id='r-84yjt9xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-142392181',owner_user_name='tempest-VolumesSnapshotTestJSON-142392181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05c741becd3a45c98e07e9d5ad726eef',uuid=99a88fab-2227-4843-b2ce-a777b481023f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converting VIF {"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.objects.instance [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'pci_devices' on Instance uuid 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:50:56 user nova-compute[72441]:   <uuid>99a88fab-2227-4843-b2ce-a777b481023f</uuid>
Aug 09 19:50:56 user nova-compute[72441]:   <name>instance-00000032</name>
Aug 09 19:50:56 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:50:56 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:50:56 user nova-compute[72441]:   <metadata>
Aug 09 19:50:56 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:50:56 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:50:56 user nova-compute[72441]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-629662610</nova:name>
Aug 09 19:50:56 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:50:56</nova:creationTime>
Aug 09 19:50:56 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:50:56 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:50:56 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:50:56 user nova-compute[72441]:       <nova:owner>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:user uuid="05c741becd3a45c98e07e9d5ad726eef">tempest-VolumesSnapshotTestJSON-142392181-project-member</nova:user>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:project uuid="3af2214a97a24954875afbb048732bfe">tempest-VolumesSnapshotTestJSON-142392181</nova:project>
Aug 09 19:50:56 user nova-compute[72441]:       </nova:owner>
Aug 09 19:50:56 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:50:56 user nova-compute[72441]:       <nova:ports>
Aug 09 19:50:56 user nova-compute[72441]:         <nova:port uuid="9807736e-04b5-4dd5-b8ad-b42a63e95947">
Aug 09 19:50:56 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 19:50:56 user nova-compute[72441]:         </nova:port>
Aug 09 19:50:56 user nova-compute[72441]:       </nova:ports>
Aug 09 19:50:56 user nova-compute[72441]:     </nova:instance>
Aug 09 19:50:56 user nova-compute[72441]:   </metadata>
Aug 09 19:50:56 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:50:56 user nova-compute[72441]:     <system>
Aug 09 19:50:56 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:50:56 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:50:56 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:50:56 user nova-compute[72441]:       <entry name="serial">99a88fab-2227-4843-b2ce-a777b481023f</entry>
Aug 09 19:50:56 user nova-compute[72441]:       <entry name="uuid">99a88fab-2227-4843-b2ce-a777b481023f</entry>
Aug 09 19:50:56 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:50:56 user nova-compute[72441]:     </system>
Aug 09 19:50:56 user nova-compute[72441]:   </sysinfo>
Aug 09 19:50:56 user nova-compute[72441]:   <os>
Aug 09 19:50:56 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:50:56 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:50:56 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:50:56 user nova-compute[72441]:   </os>
Aug 09 19:50:56 user nova-compute[72441]:   <features>
Aug 09 19:50:56 user nova-compute[72441]:     <acpi/>
Aug 09 19:50:56 user nova-compute[72441]:     <apic/>
Aug 09 19:50:56 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:50:56 user nova-compute[72441]:   </features>
Aug 09 19:50:56 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:50:56 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:50:56 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:50:56 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:50:56 user nova-compute[72441]:   </clock>
Aug 09 19:50:56 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:50:56 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:50:56 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:50:56 user nova-compute[72441]:   </cpu>
Aug 09 19:50:56 user nova-compute[72441]:   <devices>
Aug 09 19:50:56 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:50:56 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:50:56 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk"/>
Aug 09 19:50:56 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:50:56 user nova-compute[72441]:     </disk>
Aug 09 19:50:56 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:50:56 user nova-compute[72441]:       <mac address="fa:16:3e:76:7e:48"/>
Aug 09 19:50:56 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:50:56 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:50:56 user nova-compute[72441]:       <target dev="tap9807736e-04"/>
Aug 09 19:50:56 user nova-compute[72441]:     </interface>
Aug 09 19:50:56 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:50:56 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/console.log" append="off"/>
Aug 09 19:50:56 user nova-compute[72441]:     </serial>
Aug 09 19:50:56 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:50:56 user nova-compute[72441]:     <video>
Aug 09 19:50:56 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:50:56 user nova-compute[72441]:     </video>
Aug 09 19:50:56 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:50:56 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:50:56 user nova-compute[72441]:     </rng>
Aug 09 19:50:56 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:50:56 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:50:56 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:50:56 user nova-compute[72441]:     </memballoon>
Aug 09 19:50:56 user nova-compute[72441]:   </devices>
Aug 09 19:50:56 user nova-compute[72441]: </domain>
Aug 09 19:50:56 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-629662610',display_name='tempest-VolumesSnapshotTestJSON-instance-629662610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-629662610',id=50,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7Ge+SAh0ZU5Xo2j2DJv2+aAdPRwKoORKafZ3KFpu3aN++VXYJ+RLOxOAQQBilJKZEimAS3x04tx8lbiXu4Tr9Yb7NyZrS3zhrGalwyJT3aJVJ8lr54HvvscBKihUGGAg==',key_name='tempest-keypair-1278308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af2214a97a24954875afbb048732bfe',ramdisk_id='',reservation_id='r-84yjt9xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-142392181',owner_user_name='tempest-VolumesSnapshotTestJSON-142392181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05c741becd3a45c98e07e9d5ad726eef',uuid=99a88fab-2227-4843-b2ce-a777b481023f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converting VIF {"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG os_vif [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9807736e-04, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9807736e-04, col_values=(('external_ids', {'iface-id': '9807736e-04b5-4dd5-b8ad-b42a63e95947', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:7e:48', 'vm-uuid': '99a88fab-2227-4843-b2ce-a777b481023f'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:56 user nova-compute[72441]: INFO os_vif [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04')
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No VIF found with MAC fa:16:3e:76:7e:48, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updated VIF entry in instance network info cache for port 9807736e-04b5-4dd5-b8ad-b42a63e95947. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updating instance_info_cache with network_info: [{"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:50:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-52678ee3-d95e-46f9-9c13-bf1a4d8db042 req-9f01e7c9-d026-4c36-907e-b4b70e5b3152 service nova] Releasing lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:50:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-2db960cf-4c08-4033-862b-19897edcca90 req-5c7775e1-b476-4fcc-b89f-9eab7e4984f7 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2db960cf-4c08-4033-862b-19897edcca90 req-5c7775e1-b476-4fcc-b89f-9eab7e4984f7 service nova] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2db960cf-4c08-4033-862b-19897edcca90 req-5c7775e1-b476-4fcc-b89f-9eab7e4984f7 service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-2db960cf-4c08-4033-862b-19897edcca90 req-5c7775e1-b476-4fcc-b89f-9eab7e4984f7 service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG nova.compute.manager [req-2db960cf-4c08-4033-862b-19897edcca90 req-5c7775e1-b476-4fcc-b89f-9eab7e4984f7 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] No waiting events found dispatching network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:50:58 user nova-compute[72441]: WARNING nova.compute.manager [req-2db960cf-4c08-4033-862b-19897edcca90 req-5c7775e1-b476-4fcc-b89f-9eab7e4984f7 service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received unexpected event network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 for instance with vm_state building and task_state spawning.
Aug 09 19:50:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:50:58 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610660.1891243, 99a88fab-2227-4843-b2ce-a777b481023f => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] VM Resumed (Lifecycle Event)
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Instance spawned successfully.
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610660.1969838, 99a88fab-2227-4843-b2ce-a777b481023f => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] VM Started (Lifecycle Event)
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-6d8fa8c5-f95f-4262-bf74-b94dba4f4ced req-106ba092-562d-4e67-ac6c-186b5c99244a service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6d8fa8c5-f95f-4262-bf74-b94dba4f4ced req-106ba092-562d-4e67-ac6c-186b5c99244a service nova] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6d8fa8c5-f95f-4262-bf74-b94dba4f4ced req-106ba092-562d-4e67-ac6c-186b5c99244a service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6d8fa8c5-f95f-4262-bf74-b94dba4f4ced req-106ba092-562d-4e67-ac6c-186b5c99244a service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [req-6d8fa8c5-f95f-4262-bf74-b94dba4f4ced req-106ba092-562d-4e67-ac6c-186b5c99244a service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] No waiting events found dispatching network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:51:00 user nova-compute[72441]: WARNING nova.compute.manager [req-6d8fa8c5-f95f-4262-bf74-b94dba4f4ced req-106ba092-562d-4e67-ac6c-186b5c99244a service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received unexpected event network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 for instance with vm_state building and task_state spawning.
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 09 19:51:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:51:00 user nova-compute[72441]: INFO nova.compute.manager [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Took 6.52 seconds to build instance.
Aug 09 19:51:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-1539a14a-998a-4670-9b84-46f18157ad63 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.611s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:51:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-changed-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Refreshing instance network info cache due to event network-changed-1031687e-75ae-48d9-b4d9-0d4d519b5857. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Refreshing network info cache for port 1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated VIF entry in instance network info cache for port 1031687e-75ae-48d9-b4d9-0d4d519b5857. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG nova.network.neutron [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:51:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cfbe863d-0118-445c-945a-8b933150d5b5 req-aa8d6464-6c2b-49b2-a67c-c0f4e39a216f service nova] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:51:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:51:34 user nova-compute[72441]: INFO nova.compute.manager [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attaching volume 05c8adad-0a22-4096-87b4-c83de10fdfe3 to /dev/vdb
Aug 09 19:51:34 user nova-compute[72441]: DEBUG os_brick.utils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[190c45b9-47db-46ed-a3bb-0c83706e284d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f69162c-64c4-4ee8-a29c-0e393b88cb32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd3bc8-8e4f-4156-bf41-2be93b499547]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f49ce-ba94-4b96-9ec5-3a310d65d5f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:51:34 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:51:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e10166-049a-4640-adec-dd781ac131a2]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG os_brick.utils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:51:34 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating existing volume attachment record: 06c546eb-1fec-46e2-b56f-7154eddf7fe4 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:51:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGZVQztm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:51:43 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:51:43 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:51:43 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c53e36-d12c-48c0-a733-e7dc540d2041]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:51:43 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12037a44-72b3-40c3-a01a-1400929246cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3] added
Aug 09 19:51:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ea24f3-4a51-4634-b33a-b7052e95eb3e]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9f04e-721e-4e5e-8442-512490abc90d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGZVQztm {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGZVQztm" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6f7141-85b0-4206-8ba9-b3b67ad77e9c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iGZVQztm'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737306f-ef78-4e79-949a-5d9169524928]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fedd69e-8fd3-449c-a5e6-ee39bfbb7171]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:51:43 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:51:43 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:51:43 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:51:43 user nova-compute[72441]: 
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a907d5-ea0d-49fa-aeeb-0a033789748e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260]
Aug 09 19:51:43 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260] successful.
Aug 09 19:51:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb6bf79-b400-4afd-832f-85250acaf011]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2c7311-3c07-4d2e-8482-6c5322bcc963]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 (non-flash)
Aug 09 19:51:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 (non-flash)
Aug 09 19:51:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a94725-cff1-44c1-aa1a-39f39c9126a2]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:51:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGZVQztm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26363396266326631', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363396266326631', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:51:44 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:51:44 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:51:44 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:51:44 user nova-compute[72441]:   <serial>05c8adad-0a22-4096-87b4-c83de10fdfe3</serial>
Aug 09 19:51:44 user nova-compute[72441]: </disk>
Aug 09 19:51:44 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No VIF found with MAC fa:16:3e:47:64:24, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:51:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c94aed60-81d7-4926-98bb-0fe6a50e774b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.690s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:51:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:51:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:51:51 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:51:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:51:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:51:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:51:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:51:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:51:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.123390197753906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 99a88fab-2227-4843-b2ce-a777b481023f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:51:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:51:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:52:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:52:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:52:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:52:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:52:27 user nova-compute[72441]: INFO nova.compute.manager [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Detaching volume 05c8adad-0a22-4096-87b4-c83de10fdfe3
Aug 09 19:52:27 user nova-compute[72441]: INFO nova.virt.block_device [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attempting to driver detach volume 05c8adad-0a22-4096-87b4-c83de10fdfe3 from mountpoint /dev/vdb
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Attempting to detach device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:52:27 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:52:27 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:52:27 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:52:27 user nova-compute[72441]:   <serial>05c8adad-0a22-4096-87b4-c83de10fdfe3</serial>
Aug 09 19:52:27 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:52:27 user nova-compute[72441]: </disk>
Aug 09 19:52:27 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:52:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config.
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:52:27 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:52:27 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:52:27 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:52:27 user nova-compute[72441]:   <serial>05c8adad-0a22-4096-87b4-c83de10fdfe3</serial>
Aug 09 19:52:27 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:52:27 user nova-compute[72441]: </disk>
Aug 09 19:52:27 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610747.9278536, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:52:27 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config.
Aug 09 19:52:27 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGZVQztm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:52:27 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2971a3d8-a4d5-46c1-89b9-edd8794169eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c851517e-6ec4-4a6c-8d1b-e60680a40041]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 (non-flash)
Aug 09 19:52:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 (non-flash)
Aug 09 19:52:27 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:52:27 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d71a3-d14a-4ca0-8513-baacade6ef84]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a83788-f87b-49c1-b545-21bf7fd9fbca]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38528a7-b890-410f-ae46-a88b22e35b17]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[314171cf-c5dc-46b0-8f58-45429e5efd23]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47449c9-edfc-4e3b-9a5f-acf719d75f5d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c9d732-daf9-4b40-8db6-d4eac9762b0d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260]
Aug 09 19:52:28 user nova-compute[72441]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3, portal: 172.16.0.220,3260] successful.
Aug 09 19:52:28 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8adad-0a22-4096-87b4-c83de10fdfe3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a6ecf-8b82-4499-85da-7ade89bd1fec]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== disconnect_volume: return (261ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:52:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:52:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-2ce88aa9-0096-434c-afb1-d376fe2e29d2 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.651s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:52:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:52:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:52:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:52:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:52:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:52:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-changed-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:52:44 user nova-compute[72441]: DEBUG nova.compute.manager [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Refreshing instance network info cache due to event network-changed-9807736e-04b5-4dd5-b8ad-b42a63e95947. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:52:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] Acquiring lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:52:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] Acquired lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:52:44 user nova-compute[72441]: DEBUG nova.network.neutron [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Refreshing network info cache for port 9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:52:45 user nova-compute[72441]: DEBUG nova.network.neutron [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updated VIF entry in instance network info cache for port 9807736e-04b5-4dd5-b8ad-b42a63e95947. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:52:45 user nova-compute[72441]: DEBUG nova.network.neutron [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updating instance_info_cache with network_info: [{"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:52:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-447d8144-d8ca-4879-b669-716d018c51ef req-fcef614d-ac32-4276-96c1-b54cd86aa05f service nova] Releasing lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG nova.objects.instance [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'flavor' on Instance uuid 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:52:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Ignoring supplied device name: /dev/vdb
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:52:46 user nova-compute[72441]: INFO nova.compute.manager [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Attaching volume e64dd8d3-e761-483b-ba3b-faae53ac7b9d to /dev/vdb
Aug 09 19:52:46 user nova-compute[72441]: DEBUG os_brick.utils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc6383-6444-4399-a18d-101e5e705807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04cbc22-ec4b-4323-af6a-3b449f87573b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f4e22a-5ffc-4bb9-b9d6-02404e02e6a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e697ec0-c663-4dbe-9620-5650b55e024c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:52:46 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:52:46 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ad512-c89b-4b77-a9f3-87424d2f6ec9]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG os_brick.utils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updating existing volume attachment record: 4c2207f1-1454-4c93-8eb0-2f3759dcb346 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:52:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:47 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:52:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:52:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:52:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:52:51 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:52:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:52 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updating instance_info_cache with network_info: [{"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:52:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-99a88fab-2227-4843-b2ce-a777b481023f" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:52:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:52:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwjNtmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:52:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:52:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:52:54 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8182919-e7c8-4fd2-bd82-8504e8611b9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:52:54 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a49be-1329-43cf-ad79-734303830b73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d] added
Aug 09 19:52:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7e7a6-38d5-4647-91d4-2a48e2f95da1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63348ec2-2b0d-464b-a429-5e7ced17dd09]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwjNtmMq {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwjNtmMq" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b3f98a-7f28-4fae-a633-fb14f82ecc99]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwjNtmMq'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69ca37d-45e3-4282-a061-452ac279c469]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc2a0f2-aeed-4c82-8f44-25e636de4737]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:52:54 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:52:54 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:52:54 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:52:54 user nova-compute[72441]: 
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e7c2eb-4664-4e70-8f39-0b2c2eec1fd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260]
Aug 09 19:52:54 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260] successful.
Aug 09 19:52:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c7a579-e5f1-4617-975a-22bf2ab95161]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95793889-8618-433d-bbf4-62b5f91f3275]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:52:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:52:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13a2e8-5a35-4c00-8301-4cede7a81a90]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:52:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:52:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:52:55 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=25.121536254882812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 99a88fab-2227-4843-b2ce-a777b481023f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwjNtmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23638396365626230', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638396365626230', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:52:55 user nova-compute[72441]: DEBUG nova.objects.instance [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'flavor' on Instance uuid 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:52:56 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:52:56 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:52:56 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:52:56 user nova-compute[72441]:   <serial>e64dd8d3-e761-483b-ba3b-faae53ac7b9d</serial>
Aug 09 19:52:56 user nova-compute[72441]: </disk>
Aug 09 19:52:56 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No VIF found with MAC fa:16:3e:76:7e:48, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-79b5ec47-ce39-4396-bca6-836470bd9782 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.268s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:52:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:53:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:53:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:53:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Verify base images {{(pid=72441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Image id 8b031dc4-f763-4336-82c2-c504ef7f23a0 yields fingerprint 2300b4092cf850d051637d353ece7398ab56b241 {{(pid=72441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] image 8b031dc4-f763-4336-82c2-c504ef7f23a0 at (/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241): checking
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] image 8b031dc4-f763-4336-82c2-c504ef7f23a0 at (/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241): image is in use {{(pid=72441) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 is a valid instance name {{(pid=72441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 has a disk file {{(pid=72441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 is backed by 2300b4092cf850d051637d353ece7398ab56b241 {{(pid=72441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] 99a88fab-2227-4843-b2ce-a777b481023f is a valid instance name {{(pid=72441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] 99a88fab-2227-4843-b2ce-a777b481023f has a disk file {{(pid=72441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 99a88fab-2227-4843-b2ce-a777b481023f is backed by 2300b4092cf850d051637d353ece7398ab56b241 {{(pid=72441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9
Aug 09 19:53:15 user nova-compute[72441]: WARNING nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Active base files: /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Removable base files: /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807 /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7 /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21 /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9 /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a15addf03d556fcdc1cf01456a78a4cbc1ee2807
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79c84aea9a735ade76614eebcb753fd962a72ced
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3a6c977fffa73ba88b1a5721ea25673e806d178d
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/95031734c188babccf33b2d0e4fc74cc9914b3d7
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4c39ab3db63c18879c9510bbc2aa018029695f21
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7fb1ed71b899a65fa9f5f7a66d24160384cbea9e
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5969779a8d65ff13c39336c9f30801fbee4257ff
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c9aa20e0b10c2e1f8e485d788f14782a865dce9
Aug 09 19:53:15 user nova-compute[72441]: INFO nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b1bee27c3b816352345537bec5e3053394e86f02
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Verification complete {{(pid=72441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Verify swap images {{(pid=72441) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 19:53:15 user nova-compute[72441]: DEBUG nova.virt.libvirt.imagecache [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Verify ephemeral images {{(pid=72441) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 19:53:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:21 user nova-compute[72441]: INFO nova.compute.manager [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attaching volume 3614445a-3c82-414b-af41-8ecd067408b8 to /dev/vdb
Aug 09 19:53:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9b7ae-f8d1-410b-adbb-7e7b0f9a9148]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f97cc-c708-431b-bd74-266adc533808]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[54642f77-4d38-4f22-9dda-f7a244ce209b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e22c7-285f-4238-8716-6c7bd302736d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:53:21 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:53:21 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2270e92c-5582-4238-ba95-80570c38638c]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG os_brick.utils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:53:21 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating existing volume attachment record: b602e1a7-121d-4a60-b9cc-e24b70ffe153 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:53:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JigEZPct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:53:30 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:53:30 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:53:30 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1271e2-1f9f-41ce-9bc2-95f544a3f8c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:53:30 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae14ea0-670d-4204-b3bc-61d0dd8a9f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8] added
Aug 09 19:53:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1afbcf2-260e-400c-9a12-669c93a36adc]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd81004-a5f5-497b-8aa2-638fc9b22334]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JigEZPct {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JigEZPct" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[820fe198-7292-497c-b909-a3218b7ab000]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JigEZPct'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[27213016-b4ae-460d-b467-afc6dc96f72c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0e97d1-a9b0-4446-bce1-e3855d82741d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:53:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:53:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f390139-0f22-41ca-9560-20b6c31d49c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260]
Aug 09 19:53:30 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260] successful.
Aug 09 19:53:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ecedcd-e384-4416-be4e-a81dca2049b7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa2bec2-7def-4e76-b255-12f2f77fb62d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:53:30 user nova-compute[72441]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:53:30 user nova-compute[72441]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:30 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa2f7e8-7fea-4fb9-bdc6-abb0fbddc986]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:30 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:31 user nova-compute[72441]: INFO nova.compute.manager [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Detaching volume e64dd8d3-e761-483b-ba3b-faae53ac7b9d
Aug 09 19:53:31 user nova-compute[72441]: INFO nova.virt.block_device [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Attempting to driver detach volume e64dd8d3-e761-483b-ba3b-faae53ac7b9d from mountpoint /dev/vdb
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Attempting to detach device vdb from instance 99a88fab-2227-4843-b2ce-a777b481023f from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:53:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:53:31 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:53:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:53:31 user nova-compute[72441]:   <serial>e64dd8d3-e761-483b-ba3b-faae53ac7b9d</serial>
Aug 09 19:53:31 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:53:31 user nova-compute[72441]: </disk>
Aug 09 19:53:31 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:53:31 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully detached device vdb from instance 99a88fab-2227-4843-b2ce-a777b481023f from the persistent domain config.
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99a88fab-2227-4843-b2ce-a777b481023f from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:53:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:53:31 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:53:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:53:31 user nova-compute[72441]:   <serial>e64dd8d3-e761-483b-ba3b-faae53ac7b9d</serial>
Aug 09 19:53:31 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:53:31 user nova-compute[72441]: </disk>
Aug 09 19:53:31 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JigEZPct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23236656539366363', 'path': '/dev/sdc'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236656539366363', 'path': '/dev/sdc'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.objects.instance [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:53:31 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:53:31 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:53:31 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:53:31 user nova-compute[72441]:   <serial>3614445a-3c82-414b-af41-8ecd067408b8</serial>
Aug 09 19:53:31 user nova-compute[72441]: </disk>
Aug 09 19:53:31 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:53:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610812.0102355, 99a88fab-2227-4843-b2ce-a777b481023f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:53:32 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully detached device vdb from instance 99a88fab-2227-4843-b2ce-a777b481023f from the live domain config.
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwjNtmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:53:32 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c92ba16-cf03-45e0-a1df-342c806a257b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[48222a8e-6eb3-45a5-a7a0-bf757e0274ba]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:53:32 user nova-compute[72441]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d (non-flash)
Aug 09 19:53:32 user nova-compute[72441]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd984fc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No VIF found with MAC fa:16:3e:47:64:24, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f22d48-b221-4226-a028-097382da5329]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b023d468-4e0a-4710-b905-4b488e8a5b6c]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c8b735-2049-497c-84d8-f1150463beb4]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ffcc8-84a0-4647-96c6-d12ed13532fa]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccde9c4-9a4e-4616-90f0-9f0e63bb292b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-c9bc2292-bb9e-4357-a4f7-9533dd3dae36 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.473s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0904b0e-9fcc-4830-b562-f9da4f14294d]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260]
Aug 09 19:53:32 user nova-compute[72441]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d, portal: 172.16.0.220,3260] successful.
Aug 09 19:53:32 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87805b77-27e6-47a8-a712-234d381186ab]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== disconnect_volume: return (272ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:53:32 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'flavor' on Instance uuid 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-cd5849ba-5f68-4134-b33b-0669298026e7 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.958s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.842s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:33 user nova-compute[72441]: INFO nova.compute.manager [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Terminating instance
Aug 09 19:53:33 user nova-compute[72441]: DEBUG nova.compute.manager [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-d3cd3b99-1093-4f5d-b536-bebb0a789d0b req-1ce478c5-0219-417b-9a67-0889cfc0b98f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-vif-unplugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d3cd3b99-1093-4f5d-b536-bebb0a789d0b req-1ce478c5-0219-417b-9a67-0889cfc0b98f service nova] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d3cd3b99-1093-4f5d-b536-bebb0a789d0b req-1ce478c5-0219-417b-9a67-0889cfc0b98f service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-d3cd3b99-1093-4f5d-b536-bebb0a789d0b req-1ce478c5-0219-417b-9a67-0889cfc0b98f service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-d3cd3b99-1093-4f5d-b536-bebb0a789d0b req-1ce478c5-0219-417b-9a67-0889cfc0b98f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] No waiting events found dispatching network-vif-unplugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG nova.compute.manager [req-d3cd3b99-1093-4f5d-b536-bebb0a789d0b req-1ce478c5-0219-417b-9a67-0889cfc0b98f service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-vif-unplugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:33 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Instance destroyed successfully.
Aug 09 19:53:33 user nova-compute[72441]: DEBUG nova.objects.instance [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'resources' on Instance uuid 99a88fab-2227-4843-b2ce-a777b481023f {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-629662610',display_name='tempest-VolumesSnapshotTestJSON-instance-629662610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-629662610',id=50,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7Ge+SAh0ZU5Xo2j2DJv2+aAdPRwKoORKafZ3KFpu3aN++VXYJ+RLOxOAQQBilJKZEimAS3x04tx8lbiXu4Tr9Yb7NyZrS3zhrGalwyJT3aJVJ8lr54HvvscBKihUGGAg==',key_name='tempest-keypair-1278308720',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af2214a97a24954875afbb048732bfe',ramdisk_id='',reservation_id='r-84yjt9xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-142392181',owner_user_name='tempest-VolumesSnapshotTestJSON-142392181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:51:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05c741becd3a45c98e07e9d5ad726eef',uuid=99a88fab-2227-4843-b2ce-a777b481023f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converting VIF {"id": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "address": "fa:16:3e:76:7e:48", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9807736e-04", "ovs_interfaceid": "9807736e-04b5-4dd5-b8ad-b42a63e95947", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_vif [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9807736e-04, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:34 user nova-compute[72441]: INFO os_vif [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:7e:48,bridge_name='br-int',has_traffic_filtering=True,id=9807736e-04b5-4dd5-b8ad-b42a63e95947,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9807736e-04')
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwjNtmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:53:34 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64dd8d3-e761-483b-ba3b-faae53ac7b9d', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fdedd9-890f-4ebc-a231-1b100d3cc181]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe2fb3-71cb-40d9-8b09-602f2abbd478]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:34 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:34 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821fd00>, {}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Disconnecting from: [] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== disconnect_volume: return (45ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Deleting instance files /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f_del
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Deletion of /opt/stack/data/nova/instances/99a88fab-2227-4843-b2ce-a777b481023f_del complete
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.compute.manager [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.compute.manager [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Detaching volume 3614445a-3c82-414b-af41-8ecd067408b8
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.virt.block_device [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attempting to driver detach volume 3614445a-3c82-414b-af41-8ecd067408b8 from mountpoint /dev/vdb
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Attempting to detach device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:53:34 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:53:34 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:53:34 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:53:34 user nova-compute[72441]:   <serial>3614445a-3c82-414b-af41-8ecd067408b8</serial>
Aug 09 19:53:34 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:53:34 user nova-compute[72441]: </disk>
Aug 09 19:53:34 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config.
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:53:34 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:53:34 user nova-compute[72441]:   <source dev="/dev/sdc"/>
Aug 09 19:53:34 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:53:34 user nova-compute[72441]:   <serial>3614445a-3c82-414b-af41-8ecd067408b8</serial>
Aug 09 19:53:34 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:53:34 user nova-compute[72441]: </disk>
Aug 09 19:53:34 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610814.7286777, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:53:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config.
Aug 09 19:53:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JigEZPct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:53:34 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4197911-2cc1-4392-a331-ab9f9d56ed44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3e362-ce40-4354-9c68-fcc29c7e1ff5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:34 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 (non-flash)
Aug 09 19:53:34 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905cf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8'): ({'sdc'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Removing single pathed devices sdc {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68217b4-0c0c-4cb9-8972-c36d0dac343c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89809310-7e8b-45f9-b369-b01bc6b752b5]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Flushing IO for device /dev/sdc {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65b52de-4be7-43b7-9cbe-d9dcf0a5fce8]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e750fe23-abeb-4be4-bcf0-34046af4908d]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] SCSI volumes sdc have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7def3-e9bf-488a-85de-4ccd8062de57]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0340f675-8dd4-4550-bc6e-9f3b44893070]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260]
Aug 09 19:53:34 user nova-compute[72441]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8, portal: 172.16.0.220,3260] successful.
Aug 09 19:53:34 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3614445a-3c82-414b-af41-8ecd067408b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:34 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728539a-38cd-4f86-ac96-f1c1d1479846]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== disconnect_volume: return (260ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:53:35 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Took 1.07 seconds to deallocate network for instance.
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-df6b81b1-754b-4248-855b-aebd9783f7bb req-4d143cea-45b8-44ec-83f6-23908746bd2c service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-vif-deleted-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:53:35 user nova-compute[72441]: WARNING nova.volume.cinder [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Attachment 4c2207f1-1454-4c93-8eb0-2f3759dcb346 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4c2207f1-1454-4c93-8eb0-2f3759dcb346. (HTTP 404) (Request-ID: req-9d181977-532e-4005-a382-66956439f1b6)
Aug 09 19:53:35 user nova-compute[72441]: INFO nova.compute.manager [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:35 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Deleted allocations for instance 99a88fab-2227-4843-b2ce-a777b481023f
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-07f7d08d-2655-4874-9924-24732426db12 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "99a88fab-2227-4843-b2ce-a777b481023f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-9399e916-53da-49c2-817e-59a9366adb68 req-761302b6-9b2d-4a0a-ba8f-44298514285a service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received event network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9399e916-53da-49c2-817e-59a9366adb68 req-761302b6-9b2d-4a0a-ba8f-44298514285a service nova] Acquiring lock "99a88fab-2227-4843-b2ce-a777b481023f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9399e916-53da-49c2-817e-59a9366adb68 req-761302b6-9b2d-4a0a-ba8f-44298514285a service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-9399e916-53da-49c2-817e-59a9366adb68 req-761302b6-9b2d-4a0a-ba8f-44298514285a service nova] Lock "99a88fab-2227-4843-b2ce-a777b481023f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.compute.manager [req-9399e916-53da-49c2-817e-59a9366adb68 req-761302b6-9b2d-4a0a-ba8f-44298514285a service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] No waiting events found dispatching network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:53:35 user nova-compute[72441]: WARNING nova.compute.manager [req-9399e916-53da-49c2-817e-59a9366adb68 req-761302b6-9b2d-4a0a-ba8f-44298514285a service nova] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Received unexpected event network-vif-plugged-9807736e-04b5-4dd5-b8ad-b42a63e95947 for instance with vm_state deleted and task_state None.
Aug 09 19:53:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:53:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b920a4ec-ce46-4f9d-af6b-b5a41d77df53 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:48 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:53:48 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691610813.9943073, 99a88fab-2227-4843-b2ce-a777b481023f => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:53:48 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] VM Stopped (Lifecycle Event)
Aug 09 19:53:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-960d6894-bef4-47f9-91dd-562134bd69c5 None None] [instance: 99a88fab-2227-4843-b2ce-a777b481023f] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:53:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:53:52 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:53:53 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:53:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:53:53 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:53:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:53:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:53:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:53:56 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:53:56 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=25.147705078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:53:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:53:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:53:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:54:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:54:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:54:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:54:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:54:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:54:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:54:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:28 user nova-compute[72441]: INFO nova.compute.manager [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attaching volume 6396ed15-b7a3-4128-97dc-99523d115e2e to /dev/vdb
Aug 09 19:54:28 user nova-compute[72441]: DEBUG os_brick.utils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29fe6f9-07bf-43f3-bbf2-bd8770c6bd75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba04bf-4f6e-4145-96db-ac8c0e1b4b8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4eec51-027e-4dfe-bb46-a1c8735f800e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b45174-7884-4913-a484-ccbd87b92c23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:54:28 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:54:28 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92edf0c-132f-45fb-bedc-3ff6df3ace3d]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG os_brick.utils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:54:28 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating existing volume attachment record: 5c798ca6-5008-4384-b971-a03d59404be4 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:54:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBjGMrPo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:54:36 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:54:36 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:54:36 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a79e68-acd4-4ede-ad63-f8af7eca03aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:54:36 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b841c-b407-4aa8-b234-133939be5ebf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e] added
Aug 09 19:54:36 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e5167-c40a-47a1-9a60-951d38e1aa6d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19b7b7f-2d2c-48a3-b0e7-abe8e17e13d9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBjGMrPo {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBjGMrPo" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a000cc7-0162-4132-80b3-404f7957fc95]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBjGMrPo'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d139ad2-809d-4c32-9330-24e0047f4ea1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:36 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1403bcee-34e6-4e86-983e-f8e5f40f42d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:54:37 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:54:37 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:54:37 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:54:37 user nova-compute[72441]: 
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc366398-19ea-4ef5-8be6-8a38ce982d00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260]
Aug 09 19:54:37 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260] successful.
Aug 09 19:54:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd66d70-5488-4483-a89e-0bd47f3b3aa0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38a2d8-96f8-4cf0-a911-1a4c1950ea43]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e (non-flash)
Aug 09 19:54:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e (non-flash)
Aug 09 19:54:37 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dbcbed-701b-4182-9290-b0040fc0b1f0]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:54:37 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBjGMrPo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23766363634393266', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766363634393266', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:54:38 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:54:38 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:54:38 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:54:38 user nova-compute[72441]:   <serial>6396ed15-b7a3-4128-97dc-99523d115e2e</serial>
Aug 09 19:54:38 user nova-compute[72441]: </disk>
Aug 09 19:54:38 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No VIF found with MAC fa:16:3e:47:64:24, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:54:38 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7df2bac-b8e5-4c8b-9bd0-0019ab760403 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.301s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:40 user nova-compute[72441]: INFO nova.compute.manager [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Detaching volume 6396ed15-b7a3-4128-97dc-99523d115e2e
Aug 09 19:54:40 user nova-compute[72441]: INFO nova.virt.block_device [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attempting to driver detach volume 6396ed15-b7a3-4128-97dc-99523d115e2e from mountpoint /dev/vdb
Aug 09 19:54:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Attempting to detach device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:54:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:54:40 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:54:40 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:54:40 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:54:40 user nova-compute[72441]:   <serial>6396ed15-b7a3-4128-97dc-99523d115e2e</serial>
Aug 09 19:54:40 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:54:40 user nova-compute[72441]: </disk>
Aug 09 19:54:40 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:54:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config.
Aug 09 19:54:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:54:40 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:54:40 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:54:40 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:54:40 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:54:40 user nova-compute[72441]:   <serial>6396ed15-b7a3-4128-97dc-99523d115e2e</serial>
Aug 09 19:54:40 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:54:40 user nova-compute[72441]: </disk>
Aug 09 19:54:40 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610881.4737835, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:54:41 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config.
Aug 09 19:54:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBjGMrPo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:54:41 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[447ea7de-f664-43b3-ab97-9e398cb3c7fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59ea9eb-6e00-4b69-b4b5-b8338e210d0a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e (non-flash)
Aug 09 19:54:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e (non-flash)
Aug 09 19:54:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9847a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c35a5f7-9bc8-4b3e-b587-218bb375c8a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc98e7-a542-441e-b416-729f2a8b521a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b6eda7-2b7a-4844-8d0f-d8ea97ae8bba]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6ce98-1667-4dda-b1ca-14157609ed10]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[751dcd73-6622-458a-8161-a6cb8dd66e86]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e83191-9a33-4748-b92b-5bba84339952]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260]
Aug 09 19:54:41 user nova-compute[72441]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e, portal: 172.16.0.220,3260] successful.
Aug 09 19:54:41 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6396ed15-b7a3-4128-97dc-99523d115e2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3717d512-4bfc-4f3f-b66e-f0b1f0b5ca97]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== disconnect_volume: return (283ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:54:41 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:54:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:42 user nova-compute[72441]: DEBUG nova.objects.instance [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:54:42 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-95cb6bc1-7862-4124-b434-2a79c3df3178 tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.934s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 19:54:48 user nova-compute[72441]: INFO nova.compute.claims [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Claim successful on node user
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 19:54:48 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 19:54:48 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.policy [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05c741becd3a45c98e07e9d5ad726eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af2214a97a24954875afbb048732bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 19:54:49 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Creating image(s)
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "/opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "/opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk 1073741824" returned: 0 in 0.047s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Successfully created port: 8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Cannot resize image /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'migration_context' on Instance uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Ensure instance console log exists: /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:49 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Successfully updated port: 8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquired lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-changed-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.compute.manager [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Refreshing instance network info cache due to event network-changed-8e0a7a7d-2565-4ecb-926a-c3144a481978. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] Acquiring lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.neutron [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updating instance_info_cache with network_info: [{"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Releasing lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Instance network_info: |[{"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] Acquired lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.neutron [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Refreshing network info cache for port 8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Start _get_guest_xml network_info=[{"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 19:54:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:54:50 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-931359293',display_name='tempest-VolumesSnapshotTestJSON-instance-931359293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-931359293',id=51,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa4m1PN6KxY2Djrgv/qJcjW2mJrzIG4K5vSm4qXeCRL9SfJT4X9bjYEp3ZcXi0/RkQBvc3aLxDqvz3R9fyAHCQDqM6HuqWsiUbtDOlsF9fFTNmi/oHaxpU7yMD5fRk3cQ==',key_name='tempest-keypair-1189813839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af2214a97a24954875afbb048732bfe',ramdisk_id='',reservation_id='r-fa7pz84s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-142392181',owner_user_name='tempest-VolumesSnapshotTestJSON-142392181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05c741becd3a45c98e07e9d5ad726eef',uuid=8c839dc3-ca06-4982-9e96-32fd38e2db18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converting VIF {"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] End _get_guest_xml xml=<domain type="kvm">
Aug 09 19:54:50 user nova-compute[72441]:   <uuid>8c839dc3-ca06-4982-9e96-32fd38e2db18</uuid>
Aug 09 19:54:50 user nova-compute[72441]:   <name>instance-00000033</name>
Aug 09 19:54:50 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 19:54:50 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 19:54:50 user nova-compute[72441]:   <metadata>
Aug 09 19:54:50 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 19:54:50 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 19:54:50 user nova-compute[72441]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-931359293</nova:name>
Aug 09 19:54:50 user nova-compute[72441]:       <nova:creationTime>2023-08-09 19:54:50</nova:creationTime>
Aug 09 19:54:50 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 19:54:50 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 19:54:50 user nova-compute[72441]:       </nova:flavor>
Aug 09 19:54:50 user nova-compute[72441]:       <nova:owner>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:user uuid="05c741becd3a45c98e07e9d5ad726eef">tempest-VolumesSnapshotTestJSON-142392181-project-member</nova:user>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:project uuid="3af2214a97a24954875afbb048732bfe">tempest-VolumesSnapshotTestJSON-142392181</nova:project>
Aug 09 19:54:50 user nova-compute[72441]:       </nova:owner>
Aug 09 19:54:50 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 19:54:50 user nova-compute[72441]:       <nova:ports>
Aug 09 19:54:50 user nova-compute[72441]:         <nova:port uuid="8e0a7a7d-2565-4ecb-926a-c3144a481978">
Aug 09 19:54:50 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 19:54:50 user nova-compute[72441]:         </nova:port>
Aug 09 19:54:50 user nova-compute[72441]:       </nova:ports>
Aug 09 19:54:50 user nova-compute[72441]:     </nova:instance>
Aug 09 19:54:50 user nova-compute[72441]:   </metadata>
Aug 09 19:54:50 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 19:54:50 user nova-compute[72441]:     <system>
Aug 09 19:54:50 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 19:54:50 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 19:54:50 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 19:54:50 user nova-compute[72441]:       <entry name="serial">8c839dc3-ca06-4982-9e96-32fd38e2db18</entry>
Aug 09 19:54:50 user nova-compute[72441]:       <entry name="uuid">8c839dc3-ca06-4982-9e96-32fd38e2db18</entry>
Aug 09 19:54:50 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 19:54:50 user nova-compute[72441]:     </system>
Aug 09 19:54:50 user nova-compute[72441]:   </sysinfo>
Aug 09 19:54:50 user nova-compute[72441]:   <os>
Aug 09 19:54:50 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 19:54:50 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 19:54:50 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 19:54:50 user nova-compute[72441]:   </os>
Aug 09 19:54:50 user nova-compute[72441]:   <features>
Aug 09 19:54:50 user nova-compute[72441]:     <acpi/>
Aug 09 19:54:50 user nova-compute[72441]:     <apic/>
Aug 09 19:54:50 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 19:54:50 user nova-compute[72441]:   </features>
Aug 09 19:54:50 user nova-compute[72441]:   <clock offset="utc">
Aug 09 19:54:50 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 19:54:50 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 19:54:50 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 19:54:50 user nova-compute[72441]:   </clock>
Aug 09 19:54:50 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 19:54:50 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 19:54:50 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 19:54:50 user nova-compute[72441]:   </cpu>
Aug 09 19:54:50 user nova-compute[72441]:   <devices>
Aug 09 19:54:50 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 19:54:50 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 19:54:50 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk"/>
Aug 09 19:54:50 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 19:54:50 user nova-compute[72441]:     </disk>
Aug 09 19:54:50 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 19:54:50 user nova-compute[72441]:       <mac address="fa:16:3e:f6:6f:bf"/>
Aug 09 19:54:50 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:54:50 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 19:54:50 user nova-compute[72441]:       <target dev="tap8e0a7a7d-25"/>
Aug 09 19:54:50 user nova-compute[72441]:     </interface>
Aug 09 19:54:50 user nova-compute[72441]:     <serial type="pty">
Aug 09 19:54:50 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/console.log" append="off"/>
Aug 09 19:54:50 user nova-compute[72441]:     </serial>
Aug 09 19:54:50 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 19:54:50 user nova-compute[72441]:     <video>
Aug 09 19:54:50 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 19:54:50 user nova-compute[72441]:     </video>
Aug 09 19:54:50 user nova-compute[72441]:     <rng model="virtio">
Aug 09 19:54:50 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 19:54:50 user nova-compute[72441]:     </rng>
Aug 09 19:54:50 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 19:54:50 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 19:54:50 user nova-compute[72441]:       <stats period="10"/>
Aug 09 19:54:50 user nova-compute[72441]:     </memballoon>
Aug 09 19:54:50 user nova-compute[72441]:   </devices>
Aug 09 19:54:50 user nova-compute[72441]: </domain>
Aug 09 19:54:50 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-931359293',display_name='tempest-VolumesSnapshotTestJSON-instance-931359293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-931359293',id=51,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa4m1PN6KxY2Djrgv/qJcjW2mJrzIG4K5vSm4qXeCRL9SfJT4X9bjYEp3ZcXi0/RkQBvc3aLxDqvz3R9fyAHCQDqM6HuqWsiUbtDOlsF9fFTNmi/oHaxpU7yMD5fRk3cQ==',key_name='tempest-keypair-1189813839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af2214a97a24954875afbb048732bfe',ramdisk_id='',reservation_id='r-fa7pz84s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-142392181',owner_user_name='tempest-VolumesSnapshotTestJSON-142392181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T19:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05c741becd3a45c98e07e9d5ad726eef',uuid=8c839dc3-ca06-4982-9e96-32fd38e2db18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converting VIF {"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG os_vif [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e0a7a7d-25, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e0a7a7d-25, col_values=(('external_ids', {'iface-id': '8e0a7a7d-2565-4ecb-926a-c3144a481978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:6f:bf', 'vm-uuid': '8c839dc3-ca06-4982-9e96-32fd38e2db18'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:50 user nova-compute[72441]: INFO os_vif [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25')
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:54:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No VIF found with MAC fa:16:3e:f6:6f:bf, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:54:51 user nova-compute[72441]: DEBUG nova.network.neutron [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updated VIF entry in instance network info cache for port 8e0a7a7d-2565-4ecb-926a-c3144a481978. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:54:51 user nova-compute[72441]: DEBUG nova.network.neutron [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updating instance_info_cache with network_info: [{"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:54:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-e72a8313-bfdc-4090-91bd-bd8f2d2ec2a7 req-93ef2ffe-9e2c-40ee-b9b7-e2b126ec065f service nova] Releasing lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-181d650f-b2ed-4774-a518-07a52fe6888f req-e7b6d9f3-dcde-496f-a9aa-5a1dae1e07ef service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181d650f-b2ed-4774-a518-07a52fe6888f req-e7b6d9f3-dcde-496f-a9aa-5a1dae1e07ef service nova] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181d650f-b2ed-4774-a518-07a52fe6888f req-e7b6d9f3-dcde-496f-a9aa-5a1dae1e07ef service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-181d650f-b2ed-4774-a518-07a52fe6888f req-e7b6d9f3-dcde-496f-a9aa-5a1dae1e07ef service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG nova.compute.manager [req-181d650f-b2ed-4774-a518-07a52fe6888f req-e7b6d9f3-dcde-496f-a9aa-5a1dae1e07ef service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] No waiting events found dispatching network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:54:52 user nova-compute[72441]: WARNING nova.compute.manager [req-181d650f-b2ed-4774-a518-07a52fe6888f req-e7b6d9f3-dcde-496f-a9aa-5a1dae1e07ef service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received unexpected event network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 for instance with vm_state building and task_state spawning.
Aug 09 19:54:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610894.302898, 8c839dc3-ca06-4982-9e96-32fd38e2db18 => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] VM Resumed (Lifecycle Event)
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Instance spawned successfully.
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691610894.3052254, 8c839dc3-ca06-4982-9e96-32fd38e2db18 => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] VM Started (Lifecycle Event)
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-14fe7abc-f81b-4c88-ad5b-0409e2a4a62b req-09b213ac-e2bf-4b91-89c9-7368f1f35cb7 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-14fe7abc-f81b-4c88-ad5b-0409e2a4a62b req-09b213ac-e2bf-4b91-89c9-7368f1f35cb7 service nova] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-14fe7abc-f81b-4c88-ad5b-0409e2a4a62b req-09b213ac-e2bf-4b91-89c9-7368f1f35cb7 service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-14fe7abc-f81b-4c88-ad5b-0409e2a4a62b req-09b213ac-e2bf-4b91-89c9-7368f1f35cb7 service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [req-14fe7abc-f81b-4c88-ad5b-0409e2a4a62b req-09b213ac-e2bf-4b91-89c9-7368f1f35cb7 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] No waiting events found dispatching network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:54:54 user nova-compute[72441]: WARNING nova.compute.manager [req-14fe7abc-f81b-4c88-ad5b-0409e2a4a62b req-09b213ac-e2bf-4b91-89c9-7368f1f35cb7 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received unexpected event network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 for instance with vm_state building and task_state spawning.
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Skipping network cache update for instance because it is Building. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 19:54:54 user nova-compute[72441]: INFO nova.compute.manager [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Took 5.86 seconds to build instance.
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-b7890b3b-bc17-4f7b-97f9-53f7a471e7c2 tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.958s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:54:54 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:54:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:54:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:54:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:54:55 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:54:57 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:54:57 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=25.14505386352539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:54:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:54:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:55:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:55:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:55:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:55:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:55:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:55:35 user nova-compute[72441]: INFO nova.compute.manager [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attaching volume 53212cfc-0df0-422c-ab31-b5e8c168f90c to /dev/vdb
Aug 09 19:55:35 user nova-compute[72441]: DEBUG os_brick.utils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5bfcae-e9c9-4378-85cf-cc8620cb26f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c2bdd-1b75-4463-93bf-bfba18c49aaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b44afc-88a3-463e-b27b-0da2f680ac5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d5c0ff-3997-4b74-9cef-ec167a0767e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:55:35 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:55:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c14f72-8886-4fa6-8e36-1f9ee5b6caf5]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG os_brick.utils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating existing volume attachment record: 2ed97857-28b8-4249-934a-353d2751f8d5 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:55:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:55:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGcTbyav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:55:43 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:55:43 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:55:43 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7721eb-e2e9-4feb-8b8b-989275a59ac3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:55:43 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0363b74f-45e6-4758-9f35-c6a5584420e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c] added
Aug 09 19:55:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff3d252-0ced-4f4e-a8a0-439a24d7addb]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03090d-3d90-456c-ad05-d85c4f08ebb5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hGcTbyav {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hGcTbyav" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa98447d-9089-4ba4-bfa4-b90240cab9b7]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hGcTbyav'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6984ff78-8aad-4a61-974b-ee196ef13bfd]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd559e05-7736-4c4a-b481-e655c9234b10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:55:43 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:55:43 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:55:43 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:55:43 user nova-compute[72441]: 
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f33cff-eaa3-4ffb-8740-a64cf22a889a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260]
Aug 09 19:55:43 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260] successful.
Aug 09 19:55:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[400123e4-b701-4c88-a87c-b855fb8c3e4a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af7abd6-cbf6-4b93-b81c-cd66c8714a00]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c (non-flash)
Aug 09 19:55:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c (non-flash)
Aug 09 19:55:43 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a209364b-c08f-4c7c-90d6-bd61e3855ee1]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:43 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGcTbyav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26233613831666330', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233613831666330', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG nova.objects.instance [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:55:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:55:44 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:55:44 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:55:44 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:55:44 user nova-compute[72441]:   <serial>53212cfc-0df0-422c-ab31-b5e8c168f90c</serial>
Aug 09 19:55:44 user nova-compute[72441]: </disk>
Aug 09 19:55:44 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] No VIF found with MAC fa:16:3e:47:64:24, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-6be53c4a-681e-488f-901f-3c61a6dd81ed tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.037s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:55:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:55:47 user nova-compute[72441]: INFO nova.compute.manager [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Detaching volume 53212cfc-0df0-422c-ab31-b5e8c168f90c
Aug 09 19:55:47 user nova-compute[72441]: INFO nova.virt.block_device [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Attempting to driver detach volume 53212cfc-0df0-422c-ab31-b5e8c168f90c from mountpoint /dev/vdb
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Attempting to detach device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:55:47 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:55:47 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:55:47 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:55:47 user nova-compute[72441]:   <serial>53212cfc-0df0-422c-ab31-b5e8c168f90c</serial>
Aug 09 19:55:47 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:55:47 user nova-compute[72441]: </disk>
Aug 09 19:55:47 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:55:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the persistent domain config.
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:55:47 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:55:47 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:55:47 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:55:47 user nova-compute[72441]:   <serial>53212cfc-0df0-422c-ab31-b5e8c168f90c</serial>
Aug 09 19:55:47 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:55:47 user nova-compute[72441]: </disk>
Aug 09 19:55:47 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691610947.9505568, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:55:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully detached device vdb from instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 from the live domain config.
Aug 09 19:55:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGcTbyav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:55:47 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:55:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829c807-153e-4e0b-84cb-d3a5570a0136]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[382b6c87-9a3a-4b4d-b271-d36d2cdc867e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c (non-flash)
Aug 09 19:55:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c (non-flash)
Aug 09 19:55:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd90610550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6228fe0e-2427-4d6b-9192-fb5e4fa00f07]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6ee95-dea8-485f-be7a-a5e7b41bd883]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db3e354-f028-44df-86c9-c6d496de62d5]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a09f5-3003-461c-9819-2f9ebbbb16d1]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c49bc-380a-423b-ae2a-2dd247ff9d20]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb395ec-9cfe-4967-8671-2a70726be003]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260]
Aug 09 19:55:48 user nova-compute[72441]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c, portal: 172.16.0.220,3260] successful.
Aug 09 19:55:48 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53212cfc-0df0-422c-ab31-b5e8c168f90c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daf4065-7620-431c-921b-d4c140620f36]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] <== disconnect_volume: return (280ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'flavor' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:55:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-764c2269-d5cb-4daa-bdbd-6e9910b8a34b tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:55:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:50 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:50 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:55:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:55:54 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:55:55 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [{"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:55:55 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-3e34f59c-b983-4ad9-a817-36bdfb9d17f8" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:55:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:55:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:55:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:58 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:55:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:55:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8625MB free_disk=25.116111755371094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:55:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:56:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:56:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:56:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:11 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:56:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:56:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:56:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-changed-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.compute.manager [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Refreshing instance network info cache due to event network-changed-8e0a7a7d-2565-4ecb-926a-c3144a481978. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] Acquiring lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] Acquired lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Refreshing network info cache for port 8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'flavor' on Instance uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:56:40 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Ignoring supplied device name: /dev/vdb
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:56:40 user nova-compute[72441]: INFO nova.compute.manager [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Attaching volume 8014325d-5528-45d1-82ff-0a104b6d86a5 to /dev/vdb
Aug 09 19:56:40 user nova-compute[72441]: DEBUG os_brick.utils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa76e4-2d7a-4be1-9b41-4d0afc7840a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e009f50-188e-4238-be1d-899c67cb32b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f44df-cca3-4d7e-b0f6-43523611c22f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fb76f-97d1-4fd2-990d-fc68dcc7d761]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updated VIF entry in instance network info cache for port 8e0a7a7d-2565-4ecb-926a-c3144a481978. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.network.neutron [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updating instance_info_cache with network_info: [{"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ddc79322-31d6-458d-9ab3-1fbce35d1912 req-14cf2bca-7a78-4400-83b7-30696d10815e service nova] Releasing lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 19:56:40 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 19:56:40 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbc2f8e-4481-441f-a027-912dbc3327f1]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG os_brick.utils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updating existing volume attachment record: 4b796269-5b6b-4857-bc48-41528a043333 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 19:56:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbRYDaxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:56:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:56:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:56:49 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7461f63-5b8e-436a-8926-b28f8fc98d19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 19:56:49 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e4240-6d3b-49c5-b51b-b9fa1dd33ed9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5] added
Aug 09 19:56:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c77b853-d12f-4e1c-91f1-ef8e7e0022c0]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e41dbb-9965-4461-9db3-5fc8a7b12a1f]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbRYDaxQ {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbRYDaxQ" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c527a7b7-28e1-4cdb-affd-dee73239b786]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbRYDaxQ'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4d72c-3f00-42f5-8b6a-0c141e58ae1d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eac523-274a-4c6f-958f-6b3b6a441be5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:56:49 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:56:49 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:56:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:56:49 user nova-compute[72441]: 
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db99254-e7cd-4e1c-af8c-df64fa918681]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260]
Aug 09 19:56:49 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260] successful.
Aug 09 19:56:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b260e27d-e657-48ea-9cf6-2f1e28edd069]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcdb519-62e1-4864-95ac-3c500ef8a048]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 (non-flash)
Aug 09 19:56:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 (non-flash)
Aug 09 19:56:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ccbbc2-f83b-41fd-b739-9921fbf45cd0]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 19:56:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbRYDaxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 19:56:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:56:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23762626235663135', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:56:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762626235663135', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 19:56:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'flavor' on Instance uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:56:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 19:56:50 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:56:50 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:56:50 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:56:50 user nova-compute[72441]:   <serial>8014325d-5528-45d1-82ff-0a104b6d86a5</serial>
Aug 09 19:56:50 user nova-compute[72441]: </disk>
Aug 09 19:56:50 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 19:56:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] No VIF found with MAC fa:16:3e:f6:6f:bf, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0cde7cc2-f596-462a-8048-5b1dbb1d538b tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.693s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:51 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:56:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:56:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:56:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 19:56:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 19:56:56 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 19:56:57 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updating instance_info_cache with network_info: [{"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:56:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-8c839dc3-ca06-4982-9e96-32fd38e2db18" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 19:56:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 19:56:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:56:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 19:56:59 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:00 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:57:00 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.107051849365234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:57:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:57:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:57:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:15 user nova-compute[72441]: INFO nova.compute.manager [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Terminating instance
Aug 09 19:57:15 user nova-compute[72441]: DEBUG nova.compute.manager [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-62fec089-ec8a-4226-9e17-83552eb4db7e req-e6e91fea-d185-45d9-a8ca-097db1a6293d service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-vif-unplugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-62fec089-ec8a-4226-9e17-83552eb4db7e req-e6e91fea-d185-45d9-a8ca-097db1a6293d service nova] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-62fec089-ec8a-4226-9e17-83552eb4db7e req-e6e91fea-d185-45d9-a8ca-097db1a6293d service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-62fec089-ec8a-4226-9e17-83552eb4db7e req-e6e91fea-d185-45d9-a8ca-097db1a6293d service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-62fec089-ec8a-4226-9e17-83552eb4db7e req-e6e91fea-d185-45d9-a8ca-097db1a6293d service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] No waiting events found dispatching network-vif-unplugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG nova.compute.manager [req-62fec089-ec8a-4226-9e17-83552eb4db7e req-e6e91fea-d185-45d9-a8ca-097db1a6293d service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-vif-unplugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:57:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Instance destroyed successfully.
Aug 09 19:57:16 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lazy-loading 'resources' on Instance uuid 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:49:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1585515408',display_name='tempest-SnapshotDataIntegrityTests-server-1585515408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1585515408',id=49,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLafFTwaiLZCcH5vt+FZtx07bRuKKmNsnqMu5XmtIZn33U/sMaZi14AmW46bPPnVa+tj7U3lvSY73zUQ6H6v7q+W6I9GyPRnv+jAfhzdBRHh259EnSvhVuHrQYZ+SPatlA==',key_name='tempest-keypair-1313069414',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92376d6d9f604e8d8b36ce2bb581eb10',ramdisk_id='',reservation_id='r-7ud64qcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-122337818',owner_user_name='tempest-SnapshotDataIntegrityTests-122337818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c9f89b9bdc04a5ba2dec4ae86037907',uuid=3e34f59c-b983-4ad9-a817-36bdfb9d17f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Converting VIF {"id": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "address": "fa:16:3e:47:64:24", "network": {"id": "6d764680-3da4-4846-93a7-14833ca3b624", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276293743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92376d6d9f604e8d8b36ce2bb581eb10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1031687e-75", "ovs_interfaceid": "1031687e-75ae-48d9-b4d9-0d4d519b5857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG os_vif [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1031687e-75, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:16 user nova-compute[72441]: INFO os_vif [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:64:24,bridge_name='br-int',has_traffic_filtering=True,id=1031687e-75ae-48d9-b4d9-0d4d519b5857,network=Network(6d764680-3da4-4846-93a7-14833ca3b624),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1031687e-75')
Aug 09 19:57:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Deleting instance files /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8_del
Aug 09 19:57:16 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Deletion of /opt/stack/data/nova/instances/3e34f59c-b983-4ad9-a817-36bdfb9d17f8_del complete
Aug 09 19:57:16 user nova-compute[72441]: INFO nova.compute.manager [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 19:57:16 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:57:16 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:57:17 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Took 0.96 seconds to deallocate network for instance.
Aug 09 19:57:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-1a4495ba-cd1a-452f-ab37-acd875014f22 req-0f54189f-fd81-45bd-97c1-11e03ca09199 service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-vif-deleted-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:17 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Deleted allocations for instance 3e34f59c-b983-4ad9-a817-36bdfb9d17f8
Aug 09 19:57:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d1831c1b-e064-44d1-8b72-103224437d6e tempest-SnapshotDataIntegrityTests-122337818 tempest-SnapshotDataIntegrityTests-122337818-project-member] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG nova.compute.manager [req-250b9fe7-effc-4993-9e60-bc8b521e74b4 req-2ce87fbf-c142-4136-8020-6503582967ea service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received event network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-250b9fe7-effc-4993-9e60-bc8b521e74b4 req-2ce87fbf-c142-4136-8020-6503582967ea service nova] Acquiring lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:17 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-250b9fe7-effc-4993-9e60-bc8b521e74b4 req-2ce87fbf-c142-4136-8020-6503582967ea service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-250b9fe7-effc-4993-9e60-bc8b521e74b4 req-2ce87fbf-c142-4136-8020-6503582967ea service nova] Lock "3e34f59c-b983-4ad9-a817-36bdfb9d17f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.compute.manager [req-250b9fe7-effc-4993-9e60-bc8b521e74b4 req-2ce87fbf-c142-4136-8020-6503582967ea service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] No waiting events found dispatching network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:57:18 user nova-compute[72441]: WARNING nova.compute.manager [req-250b9fe7-effc-4993-9e60-bc8b521e74b4 req-2ce87fbf-c142-4136-8020-6503582967ea service nova] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Received unexpected event network-vif-plugged-1031687e-75ae-48d9-b4d9-0d4d519b5857 for instance with vm_state deleted and task_state None.
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:18 user nova-compute[72441]: INFO nova.compute.manager [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Detaching volume 8014325d-5528-45d1-82ff-0a104b6d86a5
Aug 09 19:57:18 user nova-compute[72441]: INFO nova.virt.block_device [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Attempting to driver detach volume 8014325d-5528-45d1-82ff-0a104b6d86a5 from mountpoint /dev/vdb
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Attempting to detach device vdb from instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:57:18 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:57:18 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:57:18 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:57:18 user nova-compute[72441]:   <serial>8014325d-5528-45d1-82ff-0a104b6d86a5</serial>
Aug 09 19:57:18 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:57:18 user nova-compute[72441]: </disk>
Aug 09 19:57:18 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:57:18 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully detached device vdb from instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 from the persistent domain config.
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 19:57:18 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 19:57:18 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 19:57:18 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 19:57:18 user nova-compute[72441]:   <serial>8014325d-5528-45d1-82ff-0a104b6d86a5</serial>
Aug 09 19:57:18 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 19:57:18 user nova-compute[72441]: </disk>
Aug 09 19:57:18 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691611038.609104, 8c839dc3-ca06-4982-9e96-32fd38e2db18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 19:57:18 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully detached device vdb from instance 8c839dc3-ca06-4982-9e96-32fd38e2db18 from the live domain config.
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbRYDaxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:57:18 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667c5ca-b911-4b6b-9629-a72d19614138]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e95b3d-3dfb-4e3d-88e2-501795f1dbb4]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 (non-flash)
Aug 09 19:57:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 (non-flash)
Aug 09 19:57:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd985b2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2b327-5e39-42ff-8b76-df4a3a4c6e29]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898690d-41f2-444b-be89-697fb710695a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[65751763-ff9a-4abe-98b5-4d78ad86ad72]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc5ef0-3427-4319-b5a3-4905593747fc]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a849f4d-d636-487b-b86f-d6c9109c3c6a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[18504308-0ff9-41fb-8d7c-9c0e37acce92]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260]
Aug 09 19:57:18 user nova-compute[72441]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5, portal: 172.16.0.220,3260] successful.
Aug 09 19:57:18 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd173e6e-5e1e-416e-a419-27d3af74d0e9]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== disconnect_volume: return (262ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:57:18 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG nova.objects.instance [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'flavor' on Instance uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-7c23661e-5d5f-40c1-be67-d7874eb2c52c tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.509s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:19 user nova-compute[72441]: INFO nova.compute.manager [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Terminating instance
Aug 09 19:57:19 user nova-compute[72441]: DEBUG nova.compute.manager [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-19d1193f-8c7e-4158-b361-ee6490e2177b req-73e75798-1621-40b1-9a34-20067382b96d service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-vif-unplugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19d1193f-8c7e-4158-b361-ee6490e2177b req-73e75798-1621-40b1-9a34-20067382b96d service nova] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19d1193f-8c7e-4158-b361-ee6490e2177b req-73e75798-1621-40b1-9a34-20067382b96d service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-19d1193f-8c7e-4158-b361-ee6490e2177b req-73e75798-1621-40b1-9a34-20067382b96d service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-19d1193f-8c7e-4158-b361-ee6490e2177b req-73e75798-1621-40b1-9a34-20067382b96d service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] No waiting events found dispatching network-vif-unplugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.compute.manager [req-19d1193f-8c7e-4158-b361-ee6490e2177b req-73e75798-1621-40b1-9a34-20067382b96d service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-vif-unplugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 19:57:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Instance destroyed successfully.
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.objects.instance [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lazy-loading 'resources' on Instance uuid 8c839dc3-ca06-4982-9e96-32fd38e2db18 {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T19:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-931359293',display_name='tempest-VolumesSnapshotTestJSON-instance-931359293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-931359293',id=51,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa4m1PN6KxY2Djrgv/qJcjW2mJrzIG4K5vSm4qXeCRL9SfJT4X9bjYEp3ZcXi0/RkQBvc3aLxDqvz3R9fyAHCQDqM6HuqWsiUbtDOlsF9fFTNmi/oHaxpU7yMD5fRk3cQ==',key_name='tempest-keypair-1189813839',keypairs=<?>,launch_index=0,launched_at=2023-08-09T19:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af2214a97a24954875afbb048732bfe',ramdisk_id='',reservation_id='r-fa7pz84s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-142392181',owner_user_name='tempest-VolumesSnapshotTestJSON-142392181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T19:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05c741becd3a45c98e07e9d5ad726eef',uuid=8c839dc3-ca06-4982-9e96-32fd38e2db18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converting VIF {"id": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "address": "fa:16:3e:f6:6f:bf", "network": {"id": "b55320fa-f872-4c30-9ddf-09ca16768fdf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1677710597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af2214a97a24954875afbb048732bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0a7a7d-25", "ovs_interfaceid": "8e0a7a7d-2565-4ecb-926a-c3144a481978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_vif [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e0a7a7d-25, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:20 user nova-compute[72441]: INFO os_vif [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6f:bf,bridge_name='br-int',has_traffic_filtering=True,id=8e0a7a7d-2565-4ecb-926a-c3144a481978,network=Network(b55320fa-f872-4c30-9ddf-09ca16768fdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0a7a7d-25')
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbRYDaxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 19:57:20 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8014325d-5528-45d1-82ff-0a104b6d86a5', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb1b29-cede-4e5e-a47a-bd319145ca62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:20 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 09 19:57:20 user nova-compute[72441]: 
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d1c9f-0d01-4ae2-be94-d28e4a6843b9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:57:20 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 19:57:20 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 19:57:20 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 19:57:20 user nova-compute[72441]: 
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd903f6560>, {}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Disconnecting from: [] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] <== disconnect_volume: return (46ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 19:57:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Deleting instance files /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18_del
Aug 09 19:57:20 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Deletion of /opt/stack/data/nova/instances/8c839dc3-ca06-4982-9e96-32fd38e2db18_del complete
Aug 09 19:57:20 user nova-compute[72441]: INFO nova.compute.manager [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 19:57:20 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 19:57:20 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-5b6f3804-1132-4bbf-9ce1-e49f8cb9ced2 req-12234b24-f457-4173-8938-97fa6e3ae859 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5b6f3804-1132-4bbf-9ce1-e49f8cb9ced2 req-12234b24-f457-4173-8938-97fa6e3ae859 service nova] Acquiring lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5b6f3804-1132-4bbf-9ce1-e49f8cb9ced2 req-12234b24-f457-4173-8938-97fa6e3ae859 service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-5b6f3804-1132-4bbf-9ce1-e49f8cb9ced2 req-12234b24-f457-4173-8938-97fa6e3ae859 service nova] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-5b6f3804-1132-4bbf-9ce1-e49f8cb9ced2 req-12234b24-f457-4173-8938-97fa6e3ae859 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] No waiting events found dispatching network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 19:57:22 user nova-compute[72441]: WARNING nova.compute.manager [req-5b6f3804-1132-4bbf-9ce1-e49f8cb9ced2 req-12234b24-f457-4173-8938-97fa6e3ae859 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received unexpected event network-vif-plugged-8e0a7a7d-2565-4ecb-926a-c3144a481978 for instance with vm_state active and task_state deleting.
Aug 09 19:57:22 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 19:57:22 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Took 1.62 seconds to deallocate network for instance.
Aug 09 19:57:22 user nova-compute[72441]: WARNING nova.volume.cinder [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Attachment 4b796269-5b6b-4857-bc48-41528a043333 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4b796269-5b6b-4857-bc48-41528a043333. (HTTP 404) (Request-ID: req-db1d48e7-8196-4db0-bc76-ba3e452d4707)
Aug 09 19:57:22 user nova-compute[72441]: INFO nova.compute.manager [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 19:57:22 user nova-compute[72441]: DEBUG nova.compute.manager [req-db011159-de2f-4e9f-9726-40432ab0d600 req-4bfe1f68-5715-4f63-8fec-e5ba9de37677 service nova] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Received event network-vif-deleted-8e0a7a7d-2565-4ecb-926a-c3144a481978 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:22 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Deleted allocations for instance 8c839dc3-ca06-4982-9e96-32fd38e2db18
Aug 09 19:57:22 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-51314476-2400-443c-80f2-e4147867a50e tempest-VolumesSnapshotTestJSON-142392181 tempest-VolumesSnapshotTestJSON-142392181-project-member] Lock "8c839dc3-ca06-4982-9e96-32fd38e2db18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.861s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:31 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691611036.3843896, 3e34f59c-b983-4ad9-a817-36bdfb9d17f8 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:57:31 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] VM Stopped (Lifecycle Event)
Aug 09 19:57:31 user nova-compute[72441]: DEBUG nova.compute.manager [None req-10311119-0b91-4687-943d-e8731f593c21 None None] [instance: 3e34f59c-b983-4ad9-a817-36bdfb9d17f8] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:57:35 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691611040.4466405, 8c839dc3-ca06-4982-9e96-32fd38e2db18 => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 19:57:35 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] VM Stopped (Lifecycle Event)
Aug 09 19:57:35 user nova-compute[72441]: DEBUG nova.compute.manager [None req-8a0c8372-6abb-4d5e-9a05-d92d336c51d7 None None] [instance: 8c839dc3-ca06-4982-9e96-32fd38e2db18] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 19:57:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:57:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:51 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:52 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:57:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:57:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:57:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:57:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:57:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:57:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:57:59 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:57:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.161945343017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:57:59 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:58:00 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:58:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:58:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:58:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:13 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:13 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:58:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:58:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:58:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:58:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:52 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:54 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:54 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:58:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:58:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:58:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:58:57 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:58:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:58:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:59:00 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:59:00 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 19:59:00 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.15963363647461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 19:59:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 19:59:01 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 19:59:01 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 19:59:01 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 19:59:01 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 19:59:01 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 19:59:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 19:59:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 19:59:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 19:59:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 19:59:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:59:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:59:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:15 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:18 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:25 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:30 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:59:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 19:59:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 19:59:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:59:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 19:59:35 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:40 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:45 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:50 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:55 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 19:59:55 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 19:59:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 19:59:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 19:59:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 19:59:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 19:59:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:00 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:02 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:00:03 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:00:03 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:00:03 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=25.14596176147461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:00:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Starting instance... {{(pid=72441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:00:05 user nova-compute[72441]: INFO nova.compute.claims [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Claim successful on node user
Aug 09 20:00:05 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Start building networks asynchronously for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Allocating IP information in the background. {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] allocate_for_instance() {{(pid=72441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:00:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Start building block device mappings for instance. {{(pid=72441) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Start spawning the instance on the hypervisor. {{(pid=72441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Creating instance directory {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:00:06 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Creating image(s)
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "/opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "/opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "/opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.150s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "2300b4092cf850d051637d353ece7398ab56b241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.155s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk 1073741824 {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241,backing_fmt=raw /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk 1073741824" returned: 0 in 0.069s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "2300b4092cf850d051637d353ece7398ab56b241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.policy [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64888fe709e84e519a810e7ad9421eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb3328c2fa934ec4b9524bf5bc0f9f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72441) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2300b4092cf850d051637d353ece7398ab56b241 --force-share --output=json" returned: 0 in 0.148s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk. size=1073741824 {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.virt.disk.api [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Cannot resize image /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk to a smaller size. {{(pid=72441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'migration_context' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Created local disks {{(pid=72441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Ensure instance console log exists: /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/console.log {{(pid=72441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Successfully created port: 2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Successfully updated port: 2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Building network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Instance cache missing network info. {{(pid=72441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-changed-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.compute.manager [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Refreshing instance network info cache due to event network-changed-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.network.neutron [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Instance network_info: |[{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.network.neutron [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Refreshing network info cache for port 2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:00:08 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Start _get_guest_xml network_info=[{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '8b031dc4-f763-4336-82c2-c504ef7f23a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:00:09 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:00:09 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CPU controller missing on host. {{(pid=72441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.host [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CPU controller found on host. {{(pid=72441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T19:13:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T19:13:43Z,direct_url=<?>,disk_format='qcow2',id=8b031dc4-f763-4336-82c2-c504ef7f23a0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='51e1de9317074b15852123bcf9d95af0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T19:13:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Flavor limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Image limits 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Flavor pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Image pref 0:0:0 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Got 1 possible topologies {{(pid=72441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.hardware [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1041901408',display_name='tempest-SnapshotDataIntegrityTests-server-1041901408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1041901408',id=52,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDI8KWj2/M5Kis8UHeR5l2mTy7HDZpcn9IjdbeNiLXI56XFnnzujA5yUAESfff91ERWblCt367bJ9Y/SdblLXiVK/IkdM1SXoNxztFTsPP9GOSRaO94UZ8RppdVw3rOYlQ==',key_name='tempest-keypair-189487726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3328c2fa934ec4b9524bf5bc0f9f3f',ramdisk_id='',reservation_id='r-pw6z6wz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1021000308',owner_user_name='tempest-SnapshotDataIntegrityTests-1021000308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64888fe709e84e519a810e7ad9421eed',uuid=30adbb01-79b2-44a4-940c-23bcdfd52ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Converting VIF {"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.objects.instance [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'pci_devices' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:00:09 user nova-compute[72441]:   <uuid>30adbb01-79b2-44a4-940c-23bcdfd52ecb</uuid>
Aug 09 20:00:09 user nova-compute[72441]:   <name>instance-00000034</name>
Aug 09 20:00:09 user nova-compute[72441]:   <memory>524288</memory>
Aug 09 20:00:09 user nova-compute[72441]:   <vcpu>1</vcpu>
Aug 09 20:00:09 user nova-compute[72441]:   <metadata>
Aug 09 20:00:09 user nova-compute[72441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:00:09 user nova-compute[72441]:       <nova:package version="0.0.0"/>
Aug 09 20:00:09 user nova-compute[72441]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1041901408</nova:name>
Aug 09 20:00:09 user nova-compute[72441]:       <nova:creationTime>2023-08-09 20:00:09</nova:creationTime>
Aug 09 20:00:09 user nova-compute[72441]:       <nova:flavor name="m1.tiny">
Aug 09 20:00:09 user nova-compute[72441]:         <nova:memory>512</nova:memory>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:disk>1</nova:disk>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:swap>0</nova:swap>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:00:09 user nova-compute[72441]:       </nova:flavor>
Aug 09 20:00:09 user nova-compute[72441]:       <nova:owner>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:user uuid="64888fe709e84e519a810e7ad9421eed">tempest-SnapshotDataIntegrityTests-1021000308-project-member</nova:user>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:project uuid="fb3328c2fa934ec4b9524bf5bc0f9f3f">tempest-SnapshotDataIntegrityTests-1021000308</nova:project>
Aug 09 20:00:09 user nova-compute[72441]:       </nova:owner>
Aug 09 20:00:09 user nova-compute[72441]:       <nova:root type="image" uuid="8b031dc4-f763-4336-82c2-c504ef7f23a0"/>
Aug 09 20:00:09 user nova-compute[72441]:       <nova:ports>
Aug 09 20:00:09 user nova-compute[72441]:         <nova:port uuid="2f3fa1e0-6c0f-4c45-9425-568c4a3dc502">
Aug 09 20:00:09 user nova-compute[72441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:00:09 user nova-compute[72441]:         </nova:port>
Aug 09 20:00:09 user nova-compute[72441]:       </nova:ports>
Aug 09 20:00:09 user nova-compute[72441]:     </nova:instance>
Aug 09 20:00:09 user nova-compute[72441]:   </metadata>
Aug 09 20:00:09 user nova-compute[72441]:   <sysinfo type="smbios">
Aug 09 20:00:09 user nova-compute[72441]:     <system>
Aug 09 20:00:09 user nova-compute[72441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:00:09 user nova-compute[72441]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:00:09 user nova-compute[72441]:       <entry name="version">0.0.0</entry>
Aug 09 20:00:09 user nova-compute[72441]:       <entry name="serial">30adbb01-79b2-44a4-940c-23bcdfd52ecb</entry>
Aug 09 20:00:09 user nova-compute[72441]:       <entry name="uuid">30adbb01-79b2-44a4-940c-23bcdfd52ecb</entry>
Aug 09 20:00:09 user nova-compute[72441]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:00:09 user nova-compute[72441]:     </system>
Aug 09 20:00:09 user nova-compute[72441]:   </sysinfo>
Aug 09 20:00:09 user nova-compute[72441]:   <os>
Aug 09 20:00:09 user nova-compute[72441]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:00:09 user nova-compute[72441]:     <boot dev="hd"/>
Aug 09 20:00:09 user nova-compute[72441]:     <smbios mode="sysinfo"/>
Aug 09 20:00:09 user nova-compute[72441]:   </os>
Aug 09 20:00:09 user nova-compute[72441]:   <features>
Aug 09 20:00:09 user nova-compute[72441]:     <acpi/>
Aug 09 20:00:09 user nova-compute[72441]:     <apic/>
Aug 09 20:00:09 user nova-compute[72441]:     <vmcoreinfo/>
Aug 09 20:00:09 user nova-compute[72441]:   </features>
Aug 09 20:00:09 user nova-compute[72441]:   <clock offset="utc">
Aug 09 20:00:09 user nova-compute[72441]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:00:09 user nova-compute[72441]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:00:09 user nova-compute[72441]:     <timer name="hpet" present="no"/>
Aug 09 20:00:09 user nova-compute[72441]:   </clock>
Aug 09 20:00:09 user nova-compute[72441]:   <cpu mode="custom" match="exact">
Aug 09 20:00:09 user nova-compute[72441]:     <model>Nehalem</model>
Aug 09 20:00:09 user nova-compute[72441]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:00:09 user nova-compute[72441]:   </cpu>
Aug 09 20:00:09 user nova-compute[72441]:   <devices>
Aug 09 20:00:09 user nova-compute[72441]:     <disk type="file" device="disk">
Aug 09 20:00:09 user nova-compute[72441]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:00:09 user nova-compute[72441]:       <source file="/opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk"/>
Aug 09 20:00:09 user nova-compute[72441]:       <target dev="vda" bus="virtio"/>
Aug 09 20:00:09 user nova-compute[72441]:     </disk>
Aug 09 20:00:09 user nova-compute[72441]:     <interface type="ethernet">
Aug 09 20:00:09 user nova-compute[72441]:       <mac address="fa:16:3e:7b:ff:46"/>
Aug 09 20:00:09 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 20:00:09 user nova-compute[72441]:       <mtu size="1442"/>
Aug 09 20:00:09 user nova-compute[72441]:       <target dev="tap2f3fa1e0-6c"/>
Aug 09 20:00:09 user nova-compute[72441]:     </interface>
Aug 09 20:00:09 user nova-compute[72441]:     <serial type="pty">
Aug 09 20:00:09 user nova-compute[72441]:       <log file="/opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/console.log" append="off"/>
Aug 09 20:00:09 user nova-compute[72441]:     </serial>
Aug 09 20:00:09 user nova-compute[72441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:00:09 user nova-compute[72441]:     <video>
Aug 09 20:00:09 user nova-compute[72441]:       <model type="virtio"/>
Aug 09 20:00:09 user nova-compute[72441]:     </video>
Aug 09 20:00:09 user nova-compute[72441]:     <rng model="virtio">
Aug 09 20:00:09 user nova-compute[72441]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:00:09 user nova-compute[72441]:     </rng>
Aug 09 20:00:09 user nova-compute[72441]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:00:09 user nova-compute[72441]:     <memballoon model="virtio">
Aug 09 20:00:09 user nova-compute[72441]:       <stats period="10"/>
Aug 09 20:00:09 user nova-compute[72441]:     </memballoon>
Aug 09 20:00:09 user nova-compute[72441]:   </devices>
Aug 09 20:00:09 user nova-compute[72441]: </domain>
Aug 09 20:00:09 user nova-compute[72441]:  {{(pid=72441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1041901408',display_name='tempest-SnapshotDataIntegrityTests-server-1041901408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1041901408',id=52,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDI8KWj2/M5Kis8UHeR5l2mTy7HDZpcn9IjdbeNiLXI56XFnnzujA5yUAESfff91ERWblCt367bJ9Y/SdblLXiVK/IkdM1SXoNxztFTsPP9GOSRaO94UZ8RppdVw3rOYlQ==',key_name='tempest-keypair-189487726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3328c2fa934ec4b9524bf5bc0f9f3f',ramdisk_id='',reservation_id='r-pw6z6wz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1021000308',owner_user_name='tempest-SnapshotDataIntegrityTests-1021000308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64888fe709e84e519a810e7ad9421eed',uuid=30adbb01-79b2-44a4-940c-23bcdfd52ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Converting VIF {"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG os_vif [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c') {{(pid=72441) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f3fa1e0-6c, may_exist=True, interface_attrs={}) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f3fa1e0-6c, col_values=(('external_ids', {'iface-id': '2f3fa1e0-6c0f-4c45-9425-568c4a3dc502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:ff:46', 'vm-uuid': '30adbb01-79b2-44a4-940c-23bcdfd52ecb'}),), if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:09 user nova-compute[72441]: INFO os_vif [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c')
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No VIF found with MAC fa:16:3e:7b:ff:46, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.network.neutron [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated VIF entry in instance network info cache for port 2f3fa1e0-6c0f-4c45-9425-568c4a3dc502. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG nova.network.neutron [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:00:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-cd16646c-33a5-4f85-b46d-f201be21b9e0 req-378daac0-14b1-449e-a5dd-ffd03edf1b64 service nova] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:00:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:10 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-56a905f3-6e24-4c19-9683-d7afec45bfd4 req-2bb6e877-0daa-4143-acd5-f2e3c37e3582 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-56a905f3-6e24-4c19-9683-d7afec45bfd4 req-2bb6e877-0daa-4143-acd5-f2e3c37e3582 service nova] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-56a905f3-6e24-4c19-9683-d7afec45bfd4 req-2bb6e877-0daa-4143-acd5-f2e3c37e3582 service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-56a905f3-6e24-4c19-9683-d7afec45bfd4 req-2bb6e877-0daa-4143-acd5-f2e3c37e3582 service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG nova.compute.manager [req-56a905f3-6e24-4c19-9683-d7afec45bfd4 req-2bb6e877-0daa-4143-acd5-f2e3c37e3582 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] No waiting events found dispatching network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:00:11 user nova-compute[72441]: WARNING nova.compute.manager [req-56a905f3-6e24-4c19-9683-d7afec45bfd4 req-2bb6e877-0daa-4143-acd5-f2e3c37e3582 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received unexpected event network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 for instance with vm_state building and task_state spawning.
Aug 09 20:00:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:12 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691611212.984125, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => Resumed> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:00:12 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] VM Resumed (Lifecycle Event)
Aug 09 20:00:12 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Instance event wait completed in 0 seconds for  {{(pid=72441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:00:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Guest created on hypervisor {{(pid=72441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:00:12 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Instance spawned successfully.
Aug 09 20:00:12 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Found default for hw_cdrom_bus of ide {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Found default for hw_disk_bus of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Found default for hw_input_bus of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Found default for hw_pointer_model of None {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Found default for hw_video_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Found default for hw_vif_model of virtio {{(pid=72441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:00:13 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.virt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Emitting event <LifecycleEvent: 1691611212.986165, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => Started> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:00:13 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] VM Started (Lifecycle Event)
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72441) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-4a2ea942-0624-47d5-8096-7a9955ff778c req-103ffcf5-be2e-456e-882d-83ae46b3ce85 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a2ea942-0624-47d5-8096-7a9955ff778c req-103ffcf5-be2e-456e-882d-83ae46b3ce85 service nova] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a2ea942-0624-47d5-8096-7a9955ff778c req-103ffcf5-be2e-456e-882d-83ae46b3ce85 service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-4a2ea942-0624-47d5-8096-7a9955ff778c req-103ffcf5-be2e-456e-882d-83ae46b3ce85 service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [req-4a2ea942-0624-47d5-8096-7a9955ff778c req-103ffcf5-be2e-456e-882d-83ae46b3ce85 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] No waiting events found dispatching network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:00:13 user nova-compute[72441]: WARNING nova.compute.manager [req-4a2ea942-0624-47d5-8096-7a9955ff778c req-103ffcf5-be2e-456e-882d-83ae46b3ce85 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received unexpected event network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 for instance with vm_state building and task_state spawning.
Aug 09 20:00:13 user nova-compute[72441]: INFO nova.compute.manager [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:00:13 user nova-compute[72441]: INFO nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Took 6.89 seconds to spawn the instance on the hypervisor.
Aug 09 20:00:13 user nova-compute[72441]: DEBUG nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:00:13 user nova-compute[72441]: INFO nova.compute.manager [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Took 7.62 seconds to build instance.
Aug 09 20:00:13 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-313caf10-d68b-43f9-836b-e38cfe35880b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.743s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:00:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:27 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:28 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:00:53 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:00:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:00:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:00:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:00:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:00:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:00:55 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:55 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:00:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:00:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:01:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:01:03 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:04 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:01:04 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.113658905029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:01:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:01:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:01:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:01:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:01:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:01:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:01:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:01:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:01:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:01:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-changed-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG nova.compute.manager [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Refreshing instance network info cache due to event network-changed-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502. {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:01:56 user nova-compute[72441]: DEBUG nova.network.neutron [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Refreshing network info cache for port 2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:01:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:01:57 user nova-compute[72441]: DEBUG nova.network.neutron [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated VIF entry in instance network info cache for port 2f3fa1e0-6c0f-4c45-9425-568c4a3dc502. {{(pid=72441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:01:57 user nova-compute[72441]: DEBUG nova.network.neutron [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:01:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-ffaaf121-a975-413d-9cac-3af5046841ba req-91b8f771-39bc-4c55-9bab-a348a8753211 service nova] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:01:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:01:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:02:01 user nova-compute[72441]: INFO nova.compute.manager [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attaching volume 8e69e1a2-0bcb-415b-be7d-4b567a5fab7c to /dev/vdb
Aug 09 20:02:01 user nova-compute[72441]: DEBUG os_brick.utils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b8972-a7f2-48f2-9a41-96057d76f395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019f755-4157-4a12-b919-449de2ca00b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[578fcdc7-74e4-4ad1-a7ab-cdd366883a6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ba6c97-3306-4759-8f99-0a3d174af193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:02:01 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:02:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d0cde-1361-4d10-9cc0-a966654ee26a]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG os_brick.utils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:02:01 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating existing volume attachment record: 905c102a-bec0-4ac4-8fde-9db02679f031 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:04 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:05 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:02:05 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.11209487915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:02:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:02:07 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiNKXuUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:02:10 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:02:10 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:02:10 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf416ef1-7211-4a11-82a7-d8b15411682e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:02:10 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d3cd4-cf46-4247-a7a0-b7f0faa99f7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c] added
Aug 09 20:02:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f529796-86eb-48a5-ad8d-61e66e78c64c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c20bab6-f06f-470d-98a1-3c7e2aec0a21]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiNKXuUZ {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiNKXuUZ" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e8042f-2f05-4949-9a7b-559e09d96e17]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiNKXuUZ'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c6b43-413e-465a-9e4a-8b45b1100f15]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca4df38-2e2f-4b1a-8643-b6fe05beb250]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:02:10 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:02:10 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:02:10 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 20:02:10 user nova-compute[72441]: 
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4670bbb2-c428-41f8-bf16-dd23e4fe5f8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260]
Aug 09 20:02:10 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260] successful.
Aug 09 20:02:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8ac3e-bf30-47b8-b62b-789786809468]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd3014-e771-4f4a-9227-04eeb7ba700a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c (non-flash)
Aug 09 20:02:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c (non-flash)
Aug 09 20:02:10 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[72925ac6-5b1e-4dcc-98b4-0458ea289c13]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:10 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiNKXuUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23530326631383061', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530326631383061', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:02:11 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:02:11 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:02:11 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:02:11 user nova-compute[72441]:   <serial>8e69e1a2-0bcb-415b-be7d-4b567a5fab7c</serial>
Aug 09 20:02:11 user nova-compute[72441]: </disk>
Aug 09 20:02:11 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No VIF found with MAC fa:16:3e:7b:ff:46, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:02:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d8a97404-f373-4839-a36e-dc5b7f95bed5 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.332s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:02:12 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:21 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:22 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:02:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:02:34 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:02:34 user nova-compute[72441]: INFO nova.compute.manager [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Detaching volume 8e69e1a2-0bcb-415b-be7d-4b567a5fab7c
Aug 09 20:02:34 user nova-compute[72441]: INFO nova.virt.block_device [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attempting to driver detach volume 8e69e1a2-0bcb-415b-be7d-4b567a5fab7c from mountpoint /dev/vdb
Aug 09 20:02:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Attempting to detach device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:02:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:02:34 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:02:34 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:02:34 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:02:34 user nova-compute[72441]:   <serial>8e69e1a2-0bcb-415b-be7d-4b567a5fab7c</serial>
Aug 09 20:02:34 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:02:34 user nova-compute[72441]: </disk>
Aug 09 20:02:34 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:02:34 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config.
Aug 09 20:02:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:02:34 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:02:34 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:02:34 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:02:34 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:02:34 user nova-compute[72441]:   <serial>8e69e1a2-0bcb-415b-be7d-4b567a5fab7c</serial>
Aug 09 20:02:34 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:02:34 user nova-compute[72441]: </disk>
Aug 09 20:02:34 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691611355.1912158, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:02:35 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config.
Aug 09 20:02:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiNKXuUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:02:35 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1b962-7875-43bd-850b-b1e9a1b991af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed7c04-8979-46a9-9f89-b7edfa192e28]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c (non-flash)
Aug 09 20:02:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c (non-flash)
Aug 09 20:02:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9035df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31ebbc-0c8b-429e-b38d-b866992326c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d828f-441d-4936-82a6-0daf0f25819a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40a53e5-4f39-47ad-b667-c6b300fb9828]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9a93f-88e7-4a62-a153-19a384079bc2]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7152acd2-1d1d-40cb-bdd2-4e29cfc60960]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1c177a-27d5-4439-8ec5-cdd9d85855e7]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260]
Aug 09 20:02:35 user nova-compute[72441]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c, portal: 172.16.0.220,3260] successful.
Aug 09 20:02:35 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e69e1a2-0bcb-415b-be7d-4b567a5fab7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f957d-ebc3-4664-996d-4577902ab39a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== disconnect_volume: return (280ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:02:35 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:02:36 user nova-compute[72441]: DEBUG nova.objects.instance [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:02:36 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-0f22e360-2801-4933-ae9e-3b940864d48b tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:02:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:02:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:02:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:02:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:56 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:56 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:02:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:02:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:03:02 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:03:03 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:03:03 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:03:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:03:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:03:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:03:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:03:05 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:03:05 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.471s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:06 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:03:06 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.110942840576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:03:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:03:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:03:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:03:28 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:03:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:03:29 user nova-compute[72441]: INFO nova.compute.manager [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attaching volume ddf1678b-73fb-486e-b909-0ac895562fe5 to /dev/vdb
Aug 09 20:03:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfaf101-fed3-4c62-a8ac-5eab4fdcf074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54ec68-068d-4fae-a056-48c288bc45a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9286b4-af25-4ea8-b42d-039e2c951146]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f19b78-49fa-47d3-bef7-6dd63fb6accc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:03:29 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:03:29 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[61168eb0-d5cf-435d-ac12-9a271f76db71]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG os_brick.utils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating existing volume attachment record: c9168940-954a-40e8-9480-668fd81dd688 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:03:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:32 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grkozbtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:03:42 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:03:42 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:03:42 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c83e10-386b-4b29-88ad-d6f8c25b095a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:03:42 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb85e4d-4caf-4e81-9154-765df3e3f292]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5] added
Aug 09 20:03:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60dc47-9506-46d7-8006-a524b1afaa6b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167b114-b95e-476e-b418-e00aa0e87e58]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grkozbtv {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grkozbtv" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ee79e-baae-4262-96ec-9e724d414219]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grkozbtv'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c5fbc-b64c-4a61-b6d5-a9f48396950c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d1b3bc-3d7f-413a-aa71-7ed8fc2aed12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:03:42 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:03:42 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:03:42 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 20:03:42 user nova-compute[72441]: 
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3598e9-91eb-4f85-836f-a56ef4b14538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260]
Aug 09 20:03:42 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260] successful.
Aug 09 20:03:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[288ffac6-ca9b-4763-904e-e1ac9c7f2303]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d7fa70-9f62-401b-91c7-03bf57d23072]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 (non-flash)
Aug 09 20:03:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 (non-flash)
Aug 09 20:03:42 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d87d0e-f643-45bc-9afe-a864bd027093]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:03:42 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grkozbtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:03:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:03:43 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23638613264383536', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:03:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638613264383536', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:03:43 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:03:43 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:03:43 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:03:43 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:03:43 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:03:43 user nova-compute[72441]:   <serial>ddf1678b-73fb-486e-b909-0ac895562fe5</serial>
Aug 09 20:03:43 user nova-compute[72441]: </disk>
Aug 09 20:03:43 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No VIF found with MAC fa:16:3e:7b:ff:46, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:44 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f1714216-b352-4173-b5cb-374ea8142dfb tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.430s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:03:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:03:46 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:03:46 user nova-compute[72441]: INFO nova.compute.manager [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Detaching volume ddf1678b-73fb-486e-b909-0ac895562fe5
Aug 09 20:03:46 user nova-compute[72441]: INFO nova.virt.block_device [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attempting to driver detach volume ddf1678b-73fb-486e-b909-0ac895562fe5 from mountpoint /dev/vdb
Aug 09 20:03:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Attempting to detach device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:03:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:03:46 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:03:46 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:03:46 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:03:46 user nova-compute[72441]:   <serial>ddf1678b-73fb-486e-b909-0ac895562fe5</serial>
Aug 09 20:03:46 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:03:46 user nova-compute[72441]: </disk>
Aug 09 20:03:46 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:03:46 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config.
Aug 09 20:03:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:03:46 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:03:46 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:03:46 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:03:46 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:03:46 user nova-compute[72441]:   <serial>ddf1678b-73fb-486e-b909-0ac895562fe5</serial>
Aug 09 20:03:46 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:03:46 user nova-compute[72441]: </disk>
Aug 09 20:03:46 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691611427.1855996, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:03:47 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config.
Aug 09 20:03:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grkozbtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:03:47 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6226650b-9333-429f-b073-6414dd6e12bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02bf277-7cba-4fb9-ab43-b41dfe5bd348]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 (non-flash)
Aug 09 20:03:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 (non-flash)
Aug 09 20:03:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbda7dd4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[effcc7fc-8e66-4b26-b19a-59d994357e95]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7d2640-9f06-4ed0-9bc4-273bbbfb349a]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b482a0cf-795c-4e39-a5ac-e63d4c76791d]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad3b509-b8a3-4ff8-b456-9016e056e943]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c37da-8603-4b03-8725-1270952ff51c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f01f3-814f-44e5-900b-8328e65248a3]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260]
Aug 09 20:03:47 user nova-compute[72441]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5, portal: 172.16.0.220,3260] successful.
Aug 09 20:03:47 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf1678b-73fb-486e-b909-0ac895562fe5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d44a803-c263-40ec-a9ed-8bcdabe56c38]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== disconnect_volume: return (247ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:03:47 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:03:48 user nova-compute[72441]: DEBUG nova.objects.instance [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:03:48 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-21bd13ff-2d4e-47d9-bead-5472c9eaf3f6 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.526s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:03:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:03:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:58 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:03:58 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:03:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:03:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:04:04 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:04:05 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:04:05 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:04:05 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:04:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:06 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:04:07 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.102096557617188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 20:04:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] There are 0 instances to clean {{(pid=72441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 20:04:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:11 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:04:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:16 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:16 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 20:04:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:04:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:22 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:04:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:04:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:04:40 user nova-compute[72441]: DEBUG nova.objects.instance [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:04:40 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:04:41 user nova-compute[72441]: INFO nova.compute.manager [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attaching volume 54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 to /dev/vdb
Aug 09 20:04:41 user nova-compute[72441]: DEBUG os_brick.utils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c276218e-2d2a-4861-86cf-a1f6df66db1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5539592f-be28-4836-916d-ef4ed27bf2e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99189ffc-c9cb-428f-b8d2-f2f0b92e6c47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c4295-d498-4f41-9444-4cebf4f47501]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:04:41 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:04:41 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b675b-4539-45be-9678-18bf5fb62339]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG os_brick.utils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:04:41 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating existing volume attachment record: cf3bec99-a8c1-4314-a9a9-bd801e919b31 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:04:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZbWROgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:04:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:04:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:04:49 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95c8f44-72ed-4bce-a31c-d1b4d602193f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:04:49 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc9758f-9d2d-4d7b-9b72-7b4b532ac1e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7] added
Aug 09 20:04:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6dd5bb-de29-4cdc-9f1f-b6ad43db6207]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a630e7-e88f-4291-930d-4c6dc7b15bf1]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kZbWROgX {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kZbWROgX" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e87f89-fb0f-4bc7-9459-eb22febb9c28]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kZbWROgX'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb689bd7-c8da-44e3-8274-19f3e421a74c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[67edcd36-0fac-4ffc-aca2-9be938d7b08b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:04:49 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:04:49 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:04:49 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 20:04:49 user nova-compute[72441]: 
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d555f499-f7bc-448b-84fa-5ad3507e81e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260]
Aug 09 20:04:49 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260] successful.
Aug 09 20:04:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806410b-2c2b-4fa2-89d7-a1b41dbee611]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[50501f3c-a8ac-41d8-a670-ef9b627909a7]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 (non-flash)
Aug 09 20:04:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 (non-flash)
Aug 09 20:04:49 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b91d94-d909-421f-9839-cffb16aa1ce6]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZbWROgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:04:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26364383030393933', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364383030393933', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG nova.objects.instance [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:04:50 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:04:50 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:04:50 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:04:50 user nova-compute[72441]:   <serial>54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7</serial>
Aug 09 20:04:50 user nova-compute[72441]: </disk>
Aug 09 20:04:50 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No VIF found with MAC fa:16:3e:7b:ff:46, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:04:50 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-afa94652-138a-49f4-abf0-c2fd1d365c20 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.975s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:04:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:04:53 user nova-compute[72441]: INFO nova.compute.manager [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Detaching volume 54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7
Aug 09 20:04:53 user nova-compute[72441]: INFO nova.virt.block_device [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attempting to driver detach volume 54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 from mountpoint /dev/vdb
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Attempting to detach device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:04:53 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:04:53 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:04:53 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:04:53 user nova-compute[72441]:   <serial>54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7</serial>
Aug 09 20:04:53 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:04:53 user nova-compute[72441]: </disk>
Aug 09 20:04:53 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:04:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config.
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:04:53 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:04:53 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:04:53 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:04:53 user nova-compute[72441]:   <serial>54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7</serial>
Aug 09 20:04:53 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:04:53 user nova-compute[72441]: </disk>
Aug 09 20:04:53 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691611493.8250768, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:04:53 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config.
Aug 09 20:04:53 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZbWROgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:04:53 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc7ff5-02a8-41ab-b926-8e342f3faf37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2f3b6b-51b2-4786-b916-27d98cc2edf2]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 (non-flash)
Aug 09 20:04:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 (non-flash)
Aug 09 20:04:53 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd9821cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7d6d65-d067-4649-9e77-e8c5796368ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97df3529-e68c-4499-9f93-486b94dd2eae]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa764d6-e253-441a-b1d2-ac7bc7dc26dc]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:04:53 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a157c38e-f17d-4896-832a-65cb86cb4cd9]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f1819-efe2-4a11-bc6f-aa54e184a96c]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc00eb7d-ac47-4d71-9152-e739a8716c3b]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260]
Aug 09 20:04:54 user nova-compute[72441]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7, portal: 172.16.0.220,3260] successful.
Aug 09 20:04:54 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54cfd4ea-fb03-42ff-b9da-a2a47fb1a9b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15794a0-9ba0-4558-98b1-a961fd26004b]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== disconnect_volume: return (296ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG nova.objects.instance [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:04:54 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-d03346e9-ff3d-4969-95f4-46dd42bd7a44 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:04:57 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:57 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:04:59 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:04:59 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:05:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:00 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Triggering sync for uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:05:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:05:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:05:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:05:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:05:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:05:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:08 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:05:08 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.101146697998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:05:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:05:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:05:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:05:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:05:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:05:47 user nova-compute[72441]: INFO nova.compute.manager [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attaching volume e2db0152-b357-4d96-adf8-1f2befd6ca38 to /dev/vdb
Aug 09 20:05:47 user nova-compute[72441]: DEBUG os_brick.utils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e88717d-e4e1-44d0-ad66-eb224c7ac05a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1433a7db57f1\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b55ef9-19ca-4c11-bbe9-a9c10666405b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:47 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b4650f-f43e-44fa-bb72-5d861caa866c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177ee6c-d55e-457c-aef4-45099c40216f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Running cmd (subprocess): nvme version {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] 'nvme version' failed. Not Retrying. {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] nvme not present on system {{(pid=72441) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:05:48 user nova-compute[72441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:05:48 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f5128-02c0-44c7-998d-c6e9cb847313]: (4, '') {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72441) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] LIGHTOS: no hostnqn found. {{(pid=72441) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG os_brick.utils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1433a7db57f1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:05:48 user nova-compute[72441]: DEBUG nova.virt.block_device [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating existing volume attachment record: 3dd11c4c-5a41-4091-8f0a-c8d4625ec413 {{(pid=72441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:05:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:52 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Calling os-brick to attach iSCSI Volume {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMaWOFpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:05:55 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:05:55 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:05:55 user nova-compute[72441]: INFO os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5053c2c3-238f-4aad-8a68-39990db59a9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:05:55 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --interface default --op new {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8bd972-a34a-410b-99c4-5ee838e5eee6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38] added\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38] added
Aug 09 20:05:55 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:55 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb037e6c-b908-423d-80ca-4c3e121432ff]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[09245b43-2ff8-4843-a4b1-cf0c82cfddee]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMaWOFpZ {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMaWOFpZ" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf57d66-8625-4e3c-9d9b-686435b1328a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMaWOFpZ'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814f004-3c37-4b58-b075-447519e9f930]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b845aeb4-c236-4ed8-86bf-a30d3de6246a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:05:56 user nova-compute[72441]:  {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:05:56 user nova-compute[72441]:  {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:05:56 user nova-compute[72441]: WARNING os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 20:05:56 user nova-compute[72441]: 
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --login {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db9d8c-a8c7-47f0-8a2d-caf1bc093f1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260]
Aug 09 20:05:56 user nova-compute[72441]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260] successful.
Aug 09 20:05:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca60f26-0df3-48a6-bfb6-cc145dd34e78]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a0ae16-7cd3-4348-b363-398766db2ccd]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 (non-flash)
Aug 09 20:05:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 (non-flash)
Aug 09 20:05:56 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to 172.16.0.220:3260 {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72441) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72441) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6feb08-705b-4d28-ad23-294d3c10e29b]: (4, ('- - 0', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:05:56 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72441) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMaWOFpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72441) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23433393439636532', 'path': '/dev/sdb'} {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433393439636532', 'path': '/dev/sdb'} {{(pid=72441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG nova.objects.instance [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:05:57 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:05:57 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:05:57 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:05:57 user nova-compute[72441]:   <serial>e2db0152-b357-4d96-adf8-1f2befd6ca38</serial>
Aug 09 20:05:57 user nova-compute[72441]: </disk>
Aug 09 20:05:57 user nova-compute[72441]:  {{(pid=72441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vda, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] No VIF found with MAC fa:16:3e:7b:ff:46, not building metadata {{(pid=72441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:05:57 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-5bf41b5e-eb53-4406-9a5b-8a117df3b070 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.973s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:05:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:05:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:05:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:05:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:05:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:06:00 user nova-compute[72441]: INFO nova.compute.manager [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Detaching volume e2db0152-b357-4d96-adf8-1f2befd6ca38
Aug 09 20:06:00 user nova-compute[72441]: INFO nova.virt.block_device [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Attempting to driver detach volume e2db0152-b357-4d96-adf8-1f2befd6ca38 from mountpoint /dev/vdb
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Attempting to detach device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config. {{(pid=72441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:06:00 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:06:00 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:06:00 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:06:00 user nova-compute[72441]:   <serial>e2db0152-b357-4d96-adf8-1f2befd6ca38</serial>
Aug 09 20:06:00 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:06:00 user nova-compute[72441]: </disk>
Aug 09 20:06:00 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:06:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the persistent domain config.
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config. {{(pid=72441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.guest [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:06:00 user nova-compute[72441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:06:00 user nova-compute[72441]:   <source dev="/dev/sdb"/>
Aug 09 20:06:00 user nova-compute[72441]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:06:00 user nova-compute[72441]:   <serial>e2db0152-b357-4d96-adf8-1f2befd6ca38</serial>
Aug 09 20:06:00 user nova-compute[72441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:06:00 user nova-compute[72441]: </disk>
Aug 09 20:06:00 user nova-compute[72441]:  {{(pid=72441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-6b7c8793-8344-4581-ab3d-b8e7c8a4c23b None None] Received event <DeviceRemovedEvent: 1691611560.6058822, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72441) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.driver [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:06:00 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully detached device vdb from instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb from the live domain config.
Aug 09 20:06:00 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] calling os-brick to detach iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd982e2770>, {'target_iqns': ['iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMaWOFpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:06:00 user nova-compute[72441]: WARNING os_brick.initiator.connectors.base [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38', 0)] {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01028ded-a9ec-47a2-93fe-c32b0dd44025]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840f76e-ca99-402e-b0c9-551ae99c3a0f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 (non-flash)\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 (non-flash)
Aug 09 20:06:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 (non-flash)
Aug 09 20:06:00 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd905df2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38'): ({'sdb'}, set())}) {{(pid=72441) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Removing single pathed devices sdb {{(pid=72441) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8ca108-8875-4421-96ab-f75493594444]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8780da-e0ad-40c0-bc29-20cd1df5c877]: (4, ('ok\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Flushing IO for device /dev/sdb {{(pid=72441) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f76c1-8a68-4995-9cc5-650dcc03b85a]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72441) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ede565-bde7-4ae2-a40d-97dfc6caa380]: (4, ('1', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.linuxscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] SCSI volumes sdb have been removed. {{(pid=72441) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38')] {{(pid=72441) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab6c161-2587-48ad-b97b-809a3a6d2b63]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:06:00 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --logout {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.193s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d45e1-e079-4ffe-9a03-7571a7c8c292]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260]
Aug 09 20:06:01 user nova-compute[72441]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38, portal: 172.16.0.220,3260] successful.
Aug 09 20:06:01 user nova-compute[72441]:  stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op delete {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2db0152-b357-4d96-adf8-1f2befd6ca38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83536) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e442fe7-0c86-4c25-a21e-d191e7c66552]: (4, ('', '')) {{(pid=83536) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72441) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.base [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.529s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] <== disconnect_volume: return (530ms) None {{(pid=72441) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Disconnected iSCSI Volume {{(pid=72441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG nova.objects.instance [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'flavor' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:06:01 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-fa55bcb0-a460-49df-a4e4-4f08e60ebaae tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.827s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:06:02 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:02 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:06:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:06:07 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:06:08 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:06:08 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.100116729736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing inventories for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating ProviderTree inventory for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Updating inventory in ProviderTree for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing aggregate associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, aggregates: None {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Refreshing trait associations for resource provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI {{(pid=72441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:06:08 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:06:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:06:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:27 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:06:29 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:34 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:06:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:39 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:06:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:44 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:49 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:06:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:06:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:06:54 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:06:59 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:01 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:03 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:07:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:07:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:04 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquired lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Forcefully refreshing network info cache for instance {{(pid=72441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:07:06 user nova-compute[72441]: DEBUG nova.objects.instance [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lazy-loading 'info_cache' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:07:07 user nova-compute[72441]: DEBUG nova.network.neutron [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [{"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:07:07 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Releasing lock "refresh_cache-30adbb01-79b2-44a4-940c-23bcdfd52ecb" {{(pid=72441) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:07:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updated the network info_cache for instance {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:07:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:08 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:07:09 user nova-compute[72441]: DEBUG oslo_concurrency.processutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72441) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:07:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:07:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.099334716796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:07:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:14 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:19 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:24 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:26 user nova-compute[72441]: INFO nova.compute.manager [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Terminating instance
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.compute.manager [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Start destroying the instance on the hypervisor. {{(pid=72441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-714d7e4e-14ab-4fe8-a9ff-4e375486ebee req-57e25896-78dd-4068-aade-2026c5c55bfe service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-vif-unplugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-714d7e4e-14ab-4fe8-a9ff-4e375486ebee req-57e25896-78dd-4068-aade-2026c5c55bfe service nova] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-714d7e4e-14ab-4fe8-a9ff-4e375486ebee req-57e25896-78dd-4068-aade-2026c5c55bfe service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-714d7e4e-14ab-4fe8-a9ff-4e375486ebee req-57e25896-78dd-4068-aade-2026c5c55bfe service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-714d7e4e-14ab-4fe8-a9ff-4e375486ebee req-57e25896-78dd-4068-aade-2026c5c55bfe service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] No waiting events found dispatching network-vif-unplugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.compute.manager [req-714d7e4e-14ab-4fe8-a9ff-4e375486ebee req-57e25896-78dd-4068-aade-2026c5c55bfe service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-vif-unplugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 for instance with task_state deleting. {{(pid=72441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Instance destroyed successfully.
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.objects.instance [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lazy-loading 'resources' on Instance uuid 30adbb01-79b2-44a4-940c-23bcdfd52ecb {{(pid=72441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.virt.libvirt.vif [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1041901408',display_name='tempest-SnapshotDataIntegrityTests-server-1041901408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1041901408',id=52,image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDI8KWj2/M5Kis8UHeR5l2mTy7HDZpcn9IjdbeNiLXI56XFnnzujA5yUAESfff91ERWblCt367bJ9Y/SdblLXiVK/IkdM1SXoNxztFTsPP9GOSRaO94UZ8RppdVw3rOYlQ==',key_name='tempest-keypair-189487726',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3328c2fa934ec4b9524bf5bc0f9f3f',ramdisk_id='',reservation_id='r-pw6z6wz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8b031dc4-f763-4336-82c2-c504ef7f23a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1021000308',owner_user_name='tempest-SnapshotDataIntegrityTests-1021000308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64888fe709e84e519a810e7ad9421eed',uuid=30adbb01-79b2-44a4-940c-23bcdfd52ecb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Converting VIF {"id": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "address": "fa:16:3e:7b:ff:46", "network": {"id": "18ff8c21-e677-42cb-a7c5-d4ddfa36031a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1453868282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3328c2fa934ec4b9524bf5bc0f9f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3fa1e0-6c", "ovs_interfaceid": "2f3fa1e0-6c0f-4c45-9425-568c4a3dc502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG nova.network.os_vif_util [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c') {{(pid=72441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG os_vif [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c') {{(pid=72441) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f3fa1e0-6c, bridge=br-int, if_exists=True) {{(pid=72441) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:26 user nova-compute[72441]: INFO os_vif [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ff:46,bridge_name='br-int',has_traffic_filtering=True,id=2f3fa1e0-6c0f-4c45-9425-568c4a3dc502,network=Network(18ff8c21-e677-42cb-a7c5-d4ddfa36031a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3fa1e0-6c')
Aug 09 20:07:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Deleting instance files /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb_del
Aug 09 20:07:26 user nova-compute[72441]: INFO nova.virt.libvirt.driver [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Deletion of /opt/stack/data/nova/instances/30adbb01-79b2-44a4-940c-23bcdfd52ecb_del complete
Aug 09 20:07:27 user nova-compute[72441]: INFO nova.compute.manager [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 20:07:27 user nova-compute[72441]: DEBUG oslo.service.loopingcall [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72441) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:07:27 user nova-compute[72441]: DEBUG nova.compute.manager [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Deallocating network for instance {{(pid=72441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:07:27 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] deallocate_for_instance() {{(pid=72441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:07:27 user nova-compute[72441]: DEBUG nova.network.neutron [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Updating instance_info_cache with network_info: [] {{(pid=72441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:07:28 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Took 0.94 seconds to deallocate network for instance.
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:28 user nova-compute[72441]: INFO nova.scheduler.client.report [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Deleted allocations for instance 30adbb01-79b2-44a4-940c-23bcdfd52ecb
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-f6ed72a2-d492-4454-914f-90141a20d1d7 tempest-SnapshotDataIntegrityTests-1021000308 tempest-SnapshotDataIntegrityTests-1021000308-project-member] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] Acquiring lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] Lock "30adbb01-79b2-44a4-940c-23bcdfd52ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:07:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] No waiting events found dispatching network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:07:28 user nova-compute[72441]: WARNING nova.compute.manager [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received unexpected event network-vif-plugged-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 for instance with vm_state deleted and task_state None.
Aug 09 20:07:28 user nova-compute[72441]: DEBUG nova.compute.manager [req-6c8172d9-f04b-4e48-8517-44c19552e471 req-003d7604-4499-405d-98ae-da418fb160bd service nova] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Received event network-vif-deleted-2f3fa1e0-6c0f-4c45-9425-568c4a3dc502 {{(pid=72441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:07:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:07:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:36 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691611646.9270108, 30adbb01-79b2-44a4-940c-23bcdfd52ecb => Stopped> {{(pid=72441) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:07:41 user nova-compute[72441]: INFO nova.compute.manager [-] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] VM Stopped (Lifecycle Event)
Aug 09 20:07:41 user nova-compute[72441]: DEBUG nova.compute.manager [None req-e4972831-ef50-4ae2-8878-1543a475ea75 None None] [instance: 30adbb01-79b2-44a4-940c-23bcdfd52ecb] Checking state {{(pid=72441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:41 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:46 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:07:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:07:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:07:51 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:07:56 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:01 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:08:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:03 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:04 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:04 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:08:05 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:06 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Starting heal instance info cache {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:08:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Rebuilding the list of instances to heal {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:08:07 user nova-compute[72441]: DEBUG nova.compute.manager [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Didn't find any instances for network info cache update. {{(pid=72441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 20:08:07 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:08:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:08:10 user nova-compute[72441]: WARNING nova.virt.libvirt.driver [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:08:10 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.126663208007812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:08:10 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG nova.compute.provider_tree [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed in ProviderTree for provider: e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 {{(pid=72441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG nova.scheduler.client.report [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Inventory has not changed for provider e72d66e4-de0b-4ac6-a8d5-e93a57f91dd5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG nova.compute.resource_tracker [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Compute_service record updated for user:user {{(pid=72441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG oslo_concurrency.lockutils [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72441) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:08:11 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:08:12 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:16 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:08:17 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:20 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:21 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:23 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:26 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:28 user nova-compute[72441]: DEBUG oslo_service.periodic_task [None req-4aafed0e-af93-435d-8903-4e7bb62c52f2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72441) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:08:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:08:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:08:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:08:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:08:31 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:37 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:42 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:08:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:08:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:08:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72441) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:08:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:08:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72441) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:08:47 user nova-compute[72441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72441) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}